Sep 05 04:22:23 devstack cinder-volume[77751]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 04:22:23 devstack cinder-volume[77751]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 04:22:23 devstack cinder-volume[77751]: we strongly recommend against using it for new projects. Sep 05 04:22:23 devstack cinder-volume[77751]: If you are already using Eventlet, we recommend migrating to a different Sep 05 04:22:23 devstack cinder-volume[77751]: framework. For more detail see Sep 05 04:22:23 devstack cinder-volume[77751]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 04:22:23 devstack cinder-volume[77751]: import eventlet # noqa Sep 05 04:22:25 devstack cinder-volume[77751]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 04:22:25 devstack cinder-volume[77751]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 04:22:25 devstack cinder-volume[77751]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 04:22:26 devstack cinder-volume[77751]: INFO dbcounter [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Registered counter for database cinder Sep 05 04:22:26 devstack cinder-volume[77751]: DEBUG oslo_db.sqlalchemy.engines [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77751) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:22:27 devstack cinder-volume[77751]: DEBUG dbcounter [-] [77751] Writer thread running {{(pid=77751) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 04:22:27 devstack cinder-volume[77751]: INFO cinder.rpc [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 04:22:27 devstack cinder-volume[77751]: INFO cinder.rpc [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 04:22:27 devstack cinder-volume[77751]: DEBUG oslo_db.sqlalchemy.engines [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77751) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:22:27 devstack cinder-volume[77751]: INFO cinder.volume.manager [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Determined volume DB was empty at startup. Sep 05 04:22:27 devstack cinder-volume[77751]: DEBUG cinder.volume.manager [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77751) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 04:22:27 devstack cinder-volume[77751]: INFO cinder.volume.manager [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 05 04:22:27 devstack cinder-volume[77751]: WARNING stevedore.named [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 04:22:27 devstack cinder-volume[77751]: WARNING castellan.key_manager [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 04:22:27 devstack cinder-volume[77751]: WARNING cinder.keymgr.conf_key_mgr [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 04:22:27 devstack cinder-volume[77751]: DEBUG cinder.volume.drivers.lvm [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77751) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 05 04:22:27 devstack cinder-volume[77751]: DEBUG oslo_concurrency.processutils [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77751) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:27 devstack cinder-volume[77751]: DEBUG oslo_concurrency.processutils [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] CMD "cinder-rtstool verify" returned: 0 in 0.463s {{(pid=77751) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:27 devstack cinder-volume[77751]: DEBUG oslo_db.sqlalchemy.engines [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77751) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:22:27 devstack cinder-volume[77751]: INFO cinder.rpc [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 05 04:22:28 devstack cinder-volume[77751]: INFO cinder.rpc [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 05 04:22:28 devstack cinder-volume[77751]: WARNING stevedore.named [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 04:22:28 devstack cinder-volume[77751]: WARNING castellan.key_manager [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 04:22:28 devstack cinder-volume[77751]: INFO cinder.volume.manager [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_db.sqlalchemy.engines [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77751) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:22:28 devstack cinder-volume[77751]: INFO oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Starting 1 workers Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Started child 77904 {{(pid=77751) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Full set of CONF: {{(pid=77751) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] ******************************************************************************** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Configuration options gathered from: {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 04:22:28 devstack cinder-volume[77904]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] ================================================================================ {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] allow_availability_zone_fallback = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] allow_compression_on_image_upload = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] allowed_direct_url_schemes = [] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] api_rate_limit = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] auth_strategy = keystone {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] az_cache_duration = 3600 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_availability_zone = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_host = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_name = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_stats_polling_interval = 60 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backup_api_class = cinder.backup.api.API {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backup_name_template = backup-%s {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backup_use_same_host = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backup_use_temp_snapshot = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] chap_password = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] chap_username = {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cinder_internal_tenant_project_id = 53a402bb864d413494b8e61c8c4bc662 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cinder_internal_tenant_user_id = 554b37c9cb7a4ce092c7a2635078060f {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cloned_volume_same_az = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cluster = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] compression_format = gzip {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] compute_api_class = cinder.compute.nova.API {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] config_dir = [] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] config_source = [] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] control_exchange = openstack {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] debug = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] default_availability_zone = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] default_group_type = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] default_volume_type = lvmdriver-1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] disk_geometry = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] driver_client_cert = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] driver_client_cert_key = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] driver_data_namespace = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] driver_ssl_cert_path = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] driver_ssl_cert_verify = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] driver_use_ssl = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] enable_force_upload = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] enable_new_services = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] enable_unsupported_driver = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] enabled_backends = ['lvmdriver-1'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] enforce_multipath_for_image_xfer = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] filter_function = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance_api_insecure = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance_api_ssl_compression = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance_ca_certificates_file = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance_catalog_info = image:glance:publicURL {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance_certfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance_keyfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance_num_retries = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance_request_timeout = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] goodness_function = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] graceful_shutdown_timeout = 5 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] group_api_class = cinder.group.api.API {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] host = devstack {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] image_compress_on_upload = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] image_conversion_address_space_limit = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] image_conversion_cpu_limit = 60 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] image_conversion_disable = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] image_upload_use_cinder_backend = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] image_upload_use_internal_tenant = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] image_volume_cache_enabled = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] image_volume_cache_max_count = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] image_volume_cache_max_size_gb = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] init_host_max_objects_retrieval = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] instance_format = [instance: %(uuid)s] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] iscsi_target_flags = {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] iscsi_write_cache = on {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77904]: INFO cinder.volume.manager [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] iser_helper = tgtadm {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] iser_ip_address = 192.168.122.229 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] iser_port = 3260 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] log_color = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] log_config_append = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] log_dir = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] log_file = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] log_options = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] log_rotate_interval = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] log_rotate_interval_type = days {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] log_rotation_type = none {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] max_age = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] max_logfile_count = 30 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] max_logfile_size_mb = 200 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] max_over_subscription_ratio = 20.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] message_reap_interval = 86400 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] message_ttl = 2592000 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] migration_create_volume_timeout_secs = 300 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] monkey_patch = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] monkey_patch_modules = [] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] my_ip = 192.168.122.229 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] no_snapshot_gb_quota = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] num_iser_scan_tries = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] num_shell_tries = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] num_volume_device_scan_tries = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] nvmeof_conn_info_version = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] nvmet_ns_id = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] nvmet_port_id = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] osapi_max_limit = 1000 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] osapi_volume_ext_list = [] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] osapi_volume_listen = 0.0.0.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] osapi_volume_listen_port = 8776 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] osapi_volume_use_ssl = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] osapi_volume_workers = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] per_volume_size_limit = -1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] periodic_fuzzy_delay = 60 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] periodic_interval = 60 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] project_id_regex = [0-9a-f\-]+ {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] public_endpoint = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] publish_errors = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] quota_backup_gigabytes = 1000 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] quota_backups = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] quota_gigabytes = 1000 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] quota_groups = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] quota_snapshots = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] quota_volumes = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] rate_limit_burst = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] rate_limit_except_level = CRITICAL {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] rate_limit_interval = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] reinit_driver_count = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] replication_device = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] report_discard_supported = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] report_interval = 120 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] reservation_clean_interval = 86400 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] reservation_expire = 86400 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] reserved_image_namespaces = [] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] reserved_percentage = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] rpc_response_timeout = 120 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] run_external_periodic_tasks = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] scst_target_driver = iscsi {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] scst_target_iqn_name = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_down_time = 720 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] shell_completion = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] snapshot_name_template = snapshot-%s {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] snapshot_same_host = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] split_loggers = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] state_path = /opt/stack/data/cinder {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] storage_availability_zone = nova {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] storage_protocol = iSCSI {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] syslog_log_facility = LOG_USER {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] target_helper = lioadm {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] target_ip_address = 192.168.122.229 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] target_port = 3260 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] target_protocol = iscsi {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] target_secondary_ip_addresses = [] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] trace_flags = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] transfer_api_class = cinder.transfer.api.API {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] transport_url = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] until_refresh = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] use_chap_auth = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] use_default_quota_class = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] use_journal = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] use_json = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] use_multipath_for_image_xfer = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] use_stderr = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] use_syslog = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] verify_glance_signatures = enabled {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_api_class = cinder.volume.api.API {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_backend_name = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_clear = zero {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_clear_ionice = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_clear_size = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_copy_bps_limit = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_dd_blocksize = 1M {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_name_template = volume-%s {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_service_inithost_offload = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volume_usage_audit_period = month {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] zoning_mode = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_concurrency.disable_process_locking = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.auth_section = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.auth_type = password {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.auth_version = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.cache = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.certfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.delay_auth_decision = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.http_connect_timeout = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.include_service_catalog = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.insecure = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.interface = public {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.keyfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_password = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcache_username = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.region_name = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.service_token_roles_required = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.service_type = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.token_cache_time = 300 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.backend = dogpile.cache.null {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.backend_argument = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.backend_expiration_time = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.config_prefix = cache.oslo {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.debug_cache_backend = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.enable_retry_client = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.enable_socket_keepalive = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.enabled = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.expiration_time = 600 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.hashclient_retry_attempts = 2 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.memcache_dead_retry = 300 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.memcache_pool_maxsize = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.memcache_sasl_enabled = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.password = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.proxies = [] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.redis_db = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.redis_sentinel_service_name = mymaster {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.redis_server = localhost:6379 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.retry_attempts = 2 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.retry_delay = 0.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.socket_keepalive_count = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.socket_keepalive_idle = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.socket_keepalive_interval = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.socket_timeout = 1.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.tls_allowed_ciphers = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.tls_cafile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.tls_certfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.tls_enabled = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.tls_keyfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cache.username = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] coordination.backend_url = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.asyncio_connection = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.asyncio_slave_connection = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.backend = sqlalchemy {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.connection = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.connection_debug = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.connection_parameters = {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.connection_recycle_time = 3600 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.connection_trace = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.db_inc_retry_interval = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.db_max_retries = 20 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.db_max_retry_interval = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.db_retry_interval = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.max_overflow = 50 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.max_pool_size = 5 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.max_retries = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack sudo[77948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.mysql_wsrep_sync_wait = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack sudo[77948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.pool_timeout = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.retry_interval = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.slave_connection = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.sqlite_synchronous = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.synchronous_reader = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] database.use_db_reconnect = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_tracing.insecure = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.connection_string = messaging:// {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.enabled = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.es_doc_type = notification {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.es_scroll_size = 10000 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.es_scroll_time = 2m {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.filter_error_trace = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.hmac_keys = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.sentinel_service_name = mymaster {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.socket_timeout = 0.1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.trace_requests = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler.trace_sqlalchemy = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler_jaeger.process_tags = {} {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler_jaeger.service_name_prefix = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] profiler_otlp.service_name_prefix = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_policy.enforce_new_defaults = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_policy.policy_default_rule = default {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_policy.policy_file = policy.yaml {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_policy.remote_timeout = 60.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] privsep_osbrick.group = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] privsep_osbrick.helper_command = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] privsep_osbrick.user = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cinder_sys_admin.group = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cinder_sys_admin.helper_command = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] cinder_sys_admin.user = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.auth_section = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.auth_type = password {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.cafile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.certfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.collect_timing = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.insecure = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.keyfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.send_service_user_token = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.split_loggers = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.timeout = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.tls_ciphers = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] service_user.tls_min_version = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.auth_section = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.auth_type = password {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.certfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.collect_timing = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.insecure = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.keyfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.region_name = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.split_loggers = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.timeout = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.tls_ciphers = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] glance.tls_min_version = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.backend_availability_zone = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.chap_password = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.chap_username = {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.disk_geometry = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.driver_client_cert = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.driver_client_cert_key = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.driver_data_namespace = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.driver_use_ssl = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.enable_unsupported_driver = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.extra_capabilities = {} {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.filter_function = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.goodness_function = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.iscsi_target_flags = {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.iscsi_write_cache = on {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.iser_helper = tgtadm {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.iser_port = 3260 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.lvm_mirrors = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.lvm_share_target = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.lvm_type = auto {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.num_shell_tries = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.nvmet_port_id = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.replication_device = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.report_discard_supported = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.reserved_percentage = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.scst_target_driver = iscsi {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.scst_target_iqn_name = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.storage_protocol = iSCSI {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.target_helper = tgtadm {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.target_port = 3260 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.target_protocol = iscsi {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.trace_flags = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.unique_fqdn_network = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.use_chap_auth = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.volume_backend_name = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.volume_clear = zero {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.volume_clear_ionice = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.volume_clear_size = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.volume_group = cinder-volumes {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_reports.file_event_handler = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_reports.log_dir = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.backend_availability_zone = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.backend_host = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.chap_password = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.chap_username = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.chiscsi_conf = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.disk_geometry = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.driver_client_cert = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.driver_data_namespace = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.driver_use_ssl = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.extra_capabilities = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.filter_function = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.goodness_function = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.iser_helper = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.iser_ip_address = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.iser_port = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.iser_target_prefix = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.lvm_conf_file = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.lvm_mirrors = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.lvm_share_target = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.lvm_type = auto {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.num_shell_tries = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.nvmet_port_id = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.replication_device = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.report_discard_supported = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.reserved_percentage = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.scst_target_driver = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.storage_protocol = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.target_helper = lioadm {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.target_ip_address = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.target_port = 3260 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.target_protocol = iscsi {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.trace_flags = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.use_chap_auth = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.volume_clear = zero {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.volume_clear_size = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] lvmdriver-1.volumes_dir = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.ssl = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.ssl_version = {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_notifications.driver = [] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_notifications.retry = -1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] oslo_messaging_notifications.transport_url = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] key_manager.fixed_key = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.barbican_api_version = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.barbican_endpoint = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.barbican_endpoint_type = public {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.barbican_region_name = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.cafile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.certfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.collect_timing = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.insecure = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.keyfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.number_of_retries = 60 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.retry_delay = 1 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.send_service_user_token = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.split_loggers = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.timeout = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.tls_ciphers = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.tls_min_version = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.verify_ssl = True {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican.verify_ssl_path = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.auth_section = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.auth_type = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.cafile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.certfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.collect_timing = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.insecure = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.keyfile = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.split_loggers = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.timeout = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.tls_ciphers = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] barbican_service_user.tls_min_version = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.approle_role_id = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.approle_secret_id = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.auth_method = approle {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.auth_path = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.kv_mountpoint = secret {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.kv_path = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.kv_version = 2 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.namespace = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.root_token_id = **** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.ssl_ca_crt_file = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.timeout = 60.0 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.token_file = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.token_role = None {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.use_ssl = False {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:22:28 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] ******************************************************************************** {{(pid=77751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 04:22:28 devstack sudo[77948]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:28 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:28 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:28 devstack sudo[78078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:22:28 devstack sudo[78078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:29 devstack sudo[78078]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.269s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:22:29 devstack cinder-volume[77904]: INFO cinder.brick.local_dev.lvm [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:29 devstack sudo[78168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:22:29 devstack sudo[78168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:29 devstack sudo[78168]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG cinder.brick.local_dev.lvm [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77904) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:29 devstack sudo[78252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:22:29 devstack sudo[78252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:29 devstack sudo[78252]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.499s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:29 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:29 devstack sudo[78432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:22:29 devstack sudo[78432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:30 devstack sudo[78432]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:30 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.322s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:30 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:30 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:30 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:30 devstack sudo[78519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 05 04:22:30 devstack sudo[78519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:30 devstack sudo[78519]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:30 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.268s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:30 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:30 devstack sudo[78526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:22:30 devstack sudo[78526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:30 devstack sudo[78526]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:30 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:30 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:30 devstack sudo[78606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:22:30 devstack sudo[78606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:31 devstack sudo[78606]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:31 devstack sudo[78613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:22:31 devstack sudo[78613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:31 devstack sudo[78613]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.350s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:31 devstack sudo[78698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:22:31 devstack sudo[78698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:31 devstack sudo[78698]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:31 devstack sudo[78702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:22:31 devstack sudo[78702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:31 devstack sudo[78702]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:31 devstack cinder-volume[77904]: INFO cinder.volume.drivers.lvm [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:31 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:32 devstack sudo[78706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:22:32 devstack sudo[78706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:32 devstack sudo[78706]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:32 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:32 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:22:32 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:32 devstack sudo[78715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:22:32 devstack sudo[78715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:32 devstack sudo[78715]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:32 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:32 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:32 devstack sudo[78718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:22:32 devstack sudo[78718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:32 devstack sudo[78718]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:32 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:32 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:32 devstack sudo[78721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:22:32 devstack sudo[78721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:33 devstack sudo[78721]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:33 devstack sudo[78725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:22:33 devstack sudo[78725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:33 devstack sudo[78725]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:33 devstack cinder-volume[77904]: INFO cinder.volume.driver [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG cinder.volume.driver [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77904) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG oslo_db.sqlalchemy.engines [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77904) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writer thread running {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG cinder.db.api [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Building query based on filter {{(pid=77904) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG cinder.image.image_utils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77904) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 04:22:33 devstack cinder-volume[77904]: INFO cinder.keymgr.migration [None req-5852f9cd-c73d-4844-9fd7-57e231e23639 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:33 devstack sudo[78729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:22:33 devstack sudo[78729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:33 devstack sudo[78729]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:33 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:33 devstack sudo[78733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:22:33 devstack sudo[78733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:34 devstack sudo[78733]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:34 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:34 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:34 devstack sudo[78737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:22:34 devstack sudo[78737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:34 devstack sudo[78737]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:34 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:34 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:34 devstack sudo[78740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:22:34 devstack sudo[78740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:34 devstack sudo[78740]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:34 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:34 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:22:34 devstack cinder-volume[77904]: INFO cinder.volume.manager [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Driver initialization completed successfully. Sep 05 04:22:34 devstack cinder-volume[77904]: INFO cinder.manager [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Initiating service 2 cleanup Sep 05 04:22:34 devstack cinder-volume[77904]: INFO cinder.manager [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Service 2 cleanup completed. Sep 05 04:22:34 devstack cinder-volume[77904]: DEBUG cinder.service [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Creating RPC server for service cinder-volume {{(pid=77904) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 04:22:34 devstack cinder-volume[77904]: DEBUG cinder.service [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77904) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 04:22:34 devstack cinder-volume[77904]: INFO cinder.volume.manager [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 05 04:22:34 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:22:34 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:34 devstack sudo[78744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:22:34 devstack sudo[78744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:35 devstack sudo[78744]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:35 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:35 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:35 devstack sudo[78748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:22:35 devstack sudo[78748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:35 devstack sudo[78748]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:35 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:35 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:35 devstack sudo[78751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:22:35 devstack sudo[78751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:35 devstack sudo[78751]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:35 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:35 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:22:35 devstack sudo[78757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:22:35 devstack sudo[78757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:22:35 devstack sudo[78757]: pam_unix(sudo:session): session closed for user root Sep 05 04:22:35 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:22:35 devstack cinder-volume[77904]: INFO cinder.volume.manager [None req-b987a3f8-245a-4128-b346-f5dd56852b84 None None] Driver post RPC initialization completed successfully. Sep 05 04:22:38 devstack cinder-volume[77751]: DEBUG dbcounter [-] [77751] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77751) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:22:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:22:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:23:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:23:25 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:23:25 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:24:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:24:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:24:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:24:25 devstack sudo[83988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:24:25 devstack sudo[83988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:24:26 devstack sudo[83988]: pam_unix(sudo:session): session closed for user root Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:24:26 devstack sudo[83991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:24:26 devstack sudo[83991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:24:26 devstack sudo[83991]: pam_unix(sudo:session): session closed for user root Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:24:26 devstack sudo[83994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:24:26 devstack sudo[83994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:24:26 devstack sudo[83994]: pam_unix(sudo:session): session closed for user root Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:24:26 devstack sudo[83997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:24:26 devstack sudo[83997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:24:26 devstack sudo[83997]: pam_unix(sudo:session): session closed for user root Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:24:26 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:24:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:SELECT=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:24:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:UPDATE=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:25:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:25:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:25:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:25:25 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:25:25 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:25:26 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:25:26 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:25:26 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:25:26 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:25:26 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:25:26 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:25:26 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:25:26 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:25:26 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:25:26 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:25:26 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:26:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:26:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:26:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:26:25 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:26:25 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:26:26 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Sep 05 04:26:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:26:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:26:26 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:26:26 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:26:26 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Sep 05 04:26:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:26:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:26:26 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:26:26 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:26:26 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Sep 05 04:26:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:26:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:26:26 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:26:26 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:26:26 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Sep 05 04:26:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:26:26 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:26:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:27:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:27:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:27:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:27:25 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:27:25 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:27:26 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:27:26 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:27:26 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:27:26 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:27:26 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:27:26 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:27:26 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:27:26 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:27:26 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:27:26 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:27:26 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:28:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:28:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:28:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:28:25 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:28:25 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:28:26 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Sep 05 04:28:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:28:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:28:26 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:28:26 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:28:26 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Sep 05 04:28:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:28:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:28:26 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:28:26 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:28:26 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Sep 05 04:28:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:28:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:28:26 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:28:26 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:28:27 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Sep 05 04:28:27 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:28:27 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:28:27 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:28:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:28:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:28:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:SELECT=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:28:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:UPDATE=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:29:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:29:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:29:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:29:25 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:29:25 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:29:26 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Sep 05 04:29:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:29:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:29:26 devstack sudo[87048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:29:26 devstack sudo[87048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:29:26 devstack sudo[87048]: pam_unix(sudo:session): session closed for user root Sep 05 04:29:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:29:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:29:26 devstack sudo[87051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:29:26 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:29:26 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root Sep 05 04:29:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:29:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:29:26 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:29:26 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:29:27 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Sep 05 04:29:27 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:29:27 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:29:27 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:29:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:29:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:30:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:30:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:30:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:30:25 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:30:25 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:30:26 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:30:26 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:30:26 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:30:26 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:30:26 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:30:26 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:30:26 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:30:26 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:30:26 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:30:26 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:30:26 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:30:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:31:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:31:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:31:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:31:25 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:31:25 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:31:26 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Sep 05 04:31:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:31:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:31:26 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:31:26 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:31:26 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Sep 05 04:31:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:31:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:31:26 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:31:26 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:31:26 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Sep 05 04:31:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:31:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:31:26 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:31:26 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:31:27 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Sep 05 04:31:27 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:31:27 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:31:27 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:31:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:31:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:32:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:32:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:32:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:32:26 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:32:26 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:32:26 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Sep 05 04:32:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:32:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:32:26 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:32:26 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:32:26 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Sep 05 04:32:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:32:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:32:26 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:32:26 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:32:26 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Sep 05 04:32:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:32:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:32:26 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:32:26 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:32:27 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Sep 05 04:32:27 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:32:27 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:32:27 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:32:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:32:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:32:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:33:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:33:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:33:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:33:26 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:33:26 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:33:26 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Sep 05 04:33:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:33:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:33:26 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:33:26 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:33:26 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Sep 05 04:33:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:33:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:33:26 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:33:26 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:33:26 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Sep 05 04:33:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:33:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:33:26 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:33:26 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:33:26 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Sep 05 04:33:27 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:33:27 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:33:27 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:33:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:33:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:34:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:34:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:34:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:34:26 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:34:26 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:34:26 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Sep 05 04:34:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:34:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:34:26 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:34:26 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:34:26 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Sep 05 04:34:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:34:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:34:26 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:34:26 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:34:26 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Sep 05 04:34:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:34:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:34:26 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:34:26 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:34:27 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Sep 05 04:34:27 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:34:27 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:34:27 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:34:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:34:27 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:34:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:SELECT=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:34:45 devstack cinder-volume[77904]: DEBUG dbcounter [-] [77904] Writing DB stats cinder:UPDATE=1 {{(pid=77904) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:35:25 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:35:25 devstack cinder-volume[77904]: DEBUG cinder.volume.drivers.lvm [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Updating volume stats {{(pid=77904) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 04:35:25 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:35:26 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 04:35:26 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:35:26 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:35:26 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:35:26 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:35:26 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:35:26 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 04:35:26 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:35:26 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:35:26 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 04:35:26 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:35:26 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG oslo_concurrency.processutils [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=77904) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG cinder.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Notifying Schedulers of capabilities ... {{(pid=77904) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG oslo_service.periodic_task [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] Running periodic task VolumeManager._thread_info {{(pid=77904) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread count: 6 {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:35:26 devstack cinder-volume[77904]: DEBUG cinder.volume.manager [None req-78334e84-0e7b-4ff9-92e9-5c947f2121f5 None None] thread info: [<_MainThread(MainThread, started 132981191725184)>, , , , , ] {{(pid=77904) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:35:52 devstack cinder-volume[77751]: INFO oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Caught SIGTERM, stopping children Sep 05 04:35:52 devstack cinder-volume[77751]: DEBUG oslo_concurrency.lockutils [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Acquiring lock "singleton_lock" {{(pid=77751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 04:35:52 devstack cinder-volume[77751]: DEBUG oslo_concurrency.lockutils [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Acquired lock "singleton_lock" {{(pid=77751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 04:35:52 devstack cinder-volume[77751]: DEBUG oslo_concurrency.lockutils [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Releasing lock "singleton_lock" {{(pid=77751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 04:35:52 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Stop services. {{(pid=77751) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 05 04:35:52 devstack cinder-volume[77751]: DEBUG oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Killing children. {{(pid=77751) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 05 04:35:52 devstack cinder-volume[77751]: INFO oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Waiting on 1 children to exit Sep 05 04:35:54 devstack cinder-volume[77904]: DEBUG oslo_concurrency.lockutils [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Acquiring lock "singleton_lock" {{(pid=77904) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 04:35:54 devstack cinder-volume[77904]: DEBUG oslo_concurrency.lockutils [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Acquired lock "singleton_lock" {{(pid=77904) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 04:35:54 devstack cinder-volume[77904]: DEBUG oslo_concurrency.lockutils [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Releasing lock "singleton_lock" {{(pid=77904) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 04:35:54 devstack cinder-volume[77904]: WARNING amqp [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 04:35:54 devstack cinder-volume[77904]: WARNING amqp [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 04:35:54 devstack cinder-volume[77751]: INFO oslo_service.backend._eventlet.service [None req-97be1622-08c2-4255-8116-f37a14cdd72d None None] Child 77904 exited with status 0 Sep 05 04:35:55 devstack cinder-volume[89007]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 04:35:55 devstack cinder-volume[89007]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 04:35:55 devstack cinder-volume[89007]: we strongly recommend against using it for new projects. Sep 05 04:35:55 devstack cinder-volume[89007]: If you are already using Eventlet, we recommend migrating to a different Sep 05 04:35:55 devstack cinder-volume[89007]: framework. For more detail see Sep 05 04:35:55 devstack cinder-volume[89007]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 04:35:55 devstack cinder-volume[89007]: import eventlet # noqa Sep 05 04:35:57 devstack cinder-volume[89007]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=89007) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 04:35:57 devstack cinder-volume[89007]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=89007) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 04:35:57 devstack cinder-volume[89007]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=89007) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 04:35:57 devstack cinder-volume[89007]: INFO dbcounter [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Registered counter for database cinder Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_db.sqlalchemy.engines [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89007) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG dbcounter [-] [89007] Writer thread running {{(pid=89007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 04:35:58 devstack cinder-volume[89007]: INFO cinder.rpc [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 04:35:58 devstack cinder-volume[89007]: INFO cinder.rpc [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_db.sqlalchemy.engines [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89007) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:35:58 devstack cinder-volume[89007]: INFO cinder.volume.manager [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Determined volume DB was empty at startup. Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG cinder.volume.manager [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Cinder Volume DB check: vol_db_empty=True {{(pid=89007) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 04:35:58 devstack cinder-volume[89007]: INFO cinder.volume.manager [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 05 04:35:58 devstack cinder-volume[89007]: WARNING stevedore.named [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 04:35:58 devstack cinder-volume[89007]: WARNING castellan.key_manager [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 04:35:58 devstack cinder-volume[89007]: WARNING cinder.keymgr.conf_key_mgr [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 04:35:58 devstack cinder-volume[89007]: INFO cinder.volume.manager [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_db.sqlalchemy.engines [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89007) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:35:58 devstack cinder-volume[89007]: INFO oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Starting 1 workers Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Started child 89224 {{(pid=89007) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Full set of CONF: {{(pid=89007) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] ******************************************************************************** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Configuration options gathered from: {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] ================================================================================ {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 04:35:58 devstack cinder-volume[89224]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] allow_availability_zone_fallback = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] allow_compression_on_image_upload = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] allowed_direct_url_schemes = [] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] api_rate_limit = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] auth_strategy = keystone {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_availability_zone = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_host = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_name = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_stats_polling_interval = 60 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backup_api_class = cinder.backup.api.API {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backup_name_template = backup-%s {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backup_use_same_host = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backup_use_temp_snapshot = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] chap_password = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] chap_username = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cinder_internal_tenant_project_id = 53a402bb864d413494b8e61c8c4bc662 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cinder_internal_tenant_user_id = 554b37c9cb7a4ce092c7a2635078060f {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cluster = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] compression_format = gzip {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] compute_api_class = cinder.compute.nova.API {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] config_dir = [] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] config_source = [] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] control_exchange = openstack {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] debug = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] default_availability_zone = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] default_group_type = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] default_volume_type = QuobyteHD {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] disk_geometry = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] driver_client_cert = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] driver_client_cert_key = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] driver_data_namespace = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] driver_ssl_cert_path = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] driver_ssl_cert_verify = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] driver_use_ssl = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] enable_new_services = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] enable_unsupported_driver = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] enabled_backends = ['QuobyteHD'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] enforce_multipath_for_image_xfer = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] filter_function = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance_api_insecure = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance_api_ssl_compression = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance_ca_certificates_file = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance_catalog_info = image:glance:publicURL {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance_certfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance_keyfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance_num_retries = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance_request_timeout = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] goodness_function = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] graceful_shutdown_timeout = 5 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] group_api_class = cinder.group.api.API {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] host = devstack {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] image_compress_on_upload = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] image_conversion_address_space_limit = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] image_conversion_cpu_limit = 60 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] image_conversion_disable = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] image_upload_use_cinder_backend = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] image_upload_use_internal_tenant = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] image_volume_cache_enabled = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] image_volume_cache_max_count = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] image_volume_cache_max_size_gb = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] init_host_max_objects_retrieval = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89224]: INFO cinder.volume.manager [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 05 04:35:58 devstack cinder-volume[89224]: DEBUG cinder.volume.drivers.remotefs [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89224) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] instance_format = [instance: %(uuid)s] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] iscsi_target_flags = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] iscsi_write_cache = on {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] iser_helper = tgtadm {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] iser_ip_address = 192.168.122.229 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] iser_port = 3260 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] log_color = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] log_config_append = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] log_dir = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] log_file = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] log_options = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] log_rotate_interval = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] log_rotate_interval_type = days {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] log_rotation_type = none {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] max_age = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] max_logfile_count = 30 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] max_logfile_size_mb = 200 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] max_over_subscription_ratio = 20.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] message_reap_interval = 86400 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] message_ttl = 2592000 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] migration_create_volume_timeout_secs = 300 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] monkey_patch = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] monkey_patch_modules = [] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] my_ip = 192.168.122.229 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] no_snapshot_gb_quota = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] num_iser_scan_tries = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] num_shell_tries = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] num_volume_device_scan_tries = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] nvmeof_conn_info_version = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] nvmet_ns_id = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] nvmet_port_id = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] osapi_max_limit = 1000 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] osapi_volume_ext_list = [] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] osapi_volume_listen = 0.0.0.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] osapi_volume_listen_port = 8776 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] osapi_volume_use_ssl = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] osapi_volume_workers = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] per_volume_size_limit = -1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] periodic_fuzzy_delay = 60 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] periodic_interval = 60 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] project_id_regex = [0-9a-f\-]+ {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] public_endpoint = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] publish_errors = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] quota_backup_gigabytes = 1000 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] quota_backups = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] quota_gigabytes = 1000 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] quota_groups = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] quota_snapshots = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] quota_volumes = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] rate_limit_burst = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] rate_limit_except_level = CRITICAL {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] rate_limit_interval = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] reinit_driver_count = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] replication_device = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] report_discard_supported = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] report_interval = 120 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] reservation_clean_interval = 86400 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] reservation_expire = 86400 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] reserved_image_namespaces = [] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] reserved_percentage = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] rpc_response_timeout = 120 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] run_external_periodic_tasks = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] scst_target_driver = iscsi {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] scst_target_iqn_name = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_down_time = 720 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] shell_completion = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] snapshot_name_template = snapshot-%s {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] split_loggers = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] state_path = /opt/stack/data/cinder {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] storage_availability_zone = nova {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] storage_protocol = iSCSI {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] syslog_log_facility = LOG_USER {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] target_helper = lioadm {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] target_ip_address = 192.168.122.229 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] target_port = 3260 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] target_protocol = iscsi {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] target_secondary_ip_addresses = [] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] trace_flags = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] transfer_api_class = cinder.transfer.api.API {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] transport_url = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] until_refresh = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] use_chap_auth = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] use_default_quota_class = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] use_journal = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] use_json = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] use_multipath_for_image_xfer = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] use_stderr = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] use_syslog = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] verify_glance_signatures = enabled {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_api_class = cinder.volume.api.API {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_backend_name = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_clear = zero {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_clear_ionice = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_clear_size = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_copy_bps_limit = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_dd_blocksize = 1M {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_name_template = volume-%s {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_service_inithost_offload = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volume_usage_audit_period = month {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] zoning_mode = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_concurrency.disable_process_locking = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] os_brick.lightos_discovery_client_address = localhost {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89224]: DEBUG cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89224) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 05 04:35:58 devstack cinder-volume[89224]: WARNING cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] os_brick.wait_mpath_device_interval = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89224]: WARNING cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Running cmd (subprocess): mount.quobyte {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.auth_section = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.auth_type = password {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.auth_version = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.cache = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.certfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.delay_auth_decision = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.http_connect_timeout = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.include_service_catalog = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.insecure = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.interface = public {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.keyfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_password = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_secret_key = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_security_strategy = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcache_username = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.region_name = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.service_token_roles_required = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.service_type = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.token_cache_time = 300 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.backend = dogpile.cache.null {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.backend_argument = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.backend_expiration_time = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.config_prefix = cache.oslo {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.debug_cache_backend = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.enable_retry_client = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.enable_socket_keepalive = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.enabled = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.expiration_time = 600 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.hashclient_dead_timeout = 60.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.hashclient_retry_attempts = 2 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.hashclient_retry_timeout = 1.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.memcache_dead_retry = 300 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.memcache_pool_maxsize = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.memcache_pool_unused_timeout = 60 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.memcache_sasl_enabled = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.memcache_servers = ['localhost:11211'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.password = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.proxies = [] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.redis_db = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.redis_sentinel_service_name = mymaster {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.redis_server = localhost:6379 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.retry_attempts = 2 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.retry_delay = 0.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.socket_keepalive_count = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.socket_keepalive_idle = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.socket_keepalive_interval = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.socket_timeout = 1.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.tls_allowed_ciphers = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.tls_cafile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.tls_certfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.tls_enabled = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.tls_keyfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cache.username = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] coordination.backend_url = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.asyncio_connection = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.asyncio_slave_connection = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.backend = sqlalchemy {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.connection = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.connection_debug = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.connection_parameters = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.connection_recycle_time = 3600 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.connection_trace = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89224]: DEBUG cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89224) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.db_inc_retry_interval = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.db_max_retries = 20 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.db_max_retry_interval = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.db_retry_interval = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.max_overflow = 50 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89224]: INFO cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b ... Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.max_pool_size = 5 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.max_retries = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.mysql_sql_mode = TRADITIONAL {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc -c /etc/quobyte/client-cinder.cfg {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.mysql_wsrep_sync_wait = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.pool_timeout = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.retry_interval = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.slave_connection = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.sqlite_synchronous = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.synchronous_reader = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] database.use_db_reconnect = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_metrics.metrics_process_name = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_tracing.insecure = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.connection_string = messaging:// {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.enabled = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.es_doc_type = notification {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.es_scroll_size = 10000 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.es_scroll_time = 2m {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.filter_error_trace = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.hmac_keys = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.sentinel_service_name = mymaster {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.socket_timeout = 0.1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.trace_requests = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler.trace_sqlalchemy = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler_jaeger.process_tags = {} {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler_jaeger.service_name_prefix = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] profiler_otlp.service_name_prefix = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_policy.enforce_new_defaults = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_policy.policy_default_rule = default {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_policy.policy_file = policy.yaml {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_policy.remote_timeout = 60.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc -c /etc/quobyte/client-cinder.cfg Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] privsep_osbrick.capabilities = [21, 2] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] privsep_osbrick.group = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] privsep_osbrick.helper_command = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] privsep_osbrick.log_daemon_traceback = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] privsep_osbrick.thread_pool_size = 4 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] privsep_osbrick.user = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cinder_sys_admin.group = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cinder_sys_admin.helper_command = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] cinder_sys_admin.user = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.auth_section = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.auth_type = password {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.cafile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.certfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.collect_timing = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.insecure = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.keyfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.send_service_user_token = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.split_loggers = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.timeout = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.tls_ciphers = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] service_user.tls_min_version = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.auth_section = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.auth_type = password {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.certfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:58 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.collect_timing = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.insecure = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.keyfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.region_name = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.split_loggers = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.timeout = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.tls_ciphers = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] glance.tls_min_version = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.backend_availability_zone = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.chap_password = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.chap_username = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.disk_geometry = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.driver_client_cert = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.driver_client_cert_key = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.driver_data_namespace = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.driver_ssl_cert_path = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.driver_use_ssl = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.enable_unsupported_driver = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.extra_capabilities = {} {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.filter_function = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.goodness_function = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.image_volume_cache_enabled = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.iscsi_target_flags = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.iscsi_write_cache = on {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.iser_helper = tgtadm {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.iser_port = 3260 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nas_host = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nas_login = admin {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nas_mount_options = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nas_password = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nas_private_key = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nas_secure_file_operations = auto {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nas_share_path = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nas_ssh_port = 22 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nas_volume_prov_type = thin {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.num_shell_tries = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nvmet_ns_id = 10 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.nvmet_port_id = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.quobyte_client_cfg = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.quobyte_volume_url = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.replication_device = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.report_discard_supported = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.reserved_percentage = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.scst_target_driver = iscsi {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.scst_target_iqn_name = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.storage_protocol = iSCSI {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.target_helper = tgtadm {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.target_port = 3260 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.target_protocol = iscsi {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.trace_flags = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.unique_fqdn_network = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.use_chap_auth = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.volume_backend_name = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.volume_clear = zero {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.volume_clear_ionice = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.volume_clear_size = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_reports.file_event_handler = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_reports.file_event_handler_interval = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_reports.log_dir = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.backend_availability_zone = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.backend_host = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.chap_password = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.chap_username = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.chiscsi_conf = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.disk_geometry = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.driver_client_cert = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.driver_client_cert_key = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.driver_data_namespace = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.driver_use_ssl = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.enable_unsupported_driver = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.extra_capabilities = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.filter_function = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.goodness_function = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.iscsi_target_flags = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.iscsi_write_cache = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.iser_helper = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.iser_ip_address = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.iser_port = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.iser_target_prefix = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nas_host = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nas_login = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nas_mount_options = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nas_password = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nas_private_key = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nas_secure_file_operations = false {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nas_share_path = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nas_ssh_port = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nas_volume_prov_type = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.num_iser_scan_tries = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.num_shell_tries = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nvmet_ns_id = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.nvmet_port_id = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.replication_device = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.report_discard_supported = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.reserved_percentage = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.scst_target_driver = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.scst_target_iqn_name = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.storage_protocol = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.target_helper = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.target_ip_address = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.target_port = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.target_prefix = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.target_protocol = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.trace_flags = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.unique_fqdn_network = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.use_chap_auth = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.volume_clear = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.volume_clear_ionice = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.volume_clear_size = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.volume_dd_blocksize = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] QuobyteHD.volumes_dir = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.hostname = devstack {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.ssl = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.ssl_version = {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_notifications.driver = [] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_notifications.retry = -1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] oslo_messaging_notifications.transport_url = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] key_manager.fixed_key = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.barbican_api_version = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.barbican_endpoint = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.barbican_endpoint_type = public {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.barbican_region_name = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.cafile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.certfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.collect_timing = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.insecure = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.keyfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.number_of_retries = 60 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.retry_delay = 1 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.send_service_user_token = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.split_loggers = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.timeout = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.tls_ciphers = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.tls_min_version = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.verify_ssl = True {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican.verify_ssl_path = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.auth_section = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.auth_type = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.cafile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.certfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.collect_timing = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.insecure = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.keyfile = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.split_loggers = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.timeout = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.tls_ciphers = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] barbican_service_user.tls_min_version = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.approle_role_id = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.approle_secret_id = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.auth_method = approle {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.auth_path = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.kv_mountpoint = secret {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.kv_path = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.kv_version = 2 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.namespace = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.root_token_id = **** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.ssl_ca_crt_file = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.timeout = 60.0 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.token_file = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.token_role = None {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.use_ssl = False {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:35:59 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] ******************************************************************************** {{(pid=89007) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 04:35:59 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.400s {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:35:59 devstack cinder-volume[89224]: INFO cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b succeeded Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89224) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.414s {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:35:59 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:35:59 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:35:59 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.246s {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:35:59 devstack cinder-volume[89224]: INFO cinder.volume.driver [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG cinder.volume.driver [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7087516784668, 'free_capacity_gb': 1773.7087516784668, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89224) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG oslo_db.sqlalchemy.engines [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG dbcounter [-] [89224] Writer thread running {{(pid=89224) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG cinder.db.api [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Building query based on filter {{(pid=89224) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG cinder.image.image_utils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89224) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 04:35:59 devstack cinder-volume[89224]: INFO cinder.keymgr.migration [None req-24e8e523-1519-4cc4-b81b-32518523bc3e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89224) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89224) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:35:59 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:35:59 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:35:59 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.234s {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:35:59 devstack cinder-volume[89224]: DEBUG cinder.manager [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Notifying Schedulers of capabilities ... {{(pid=89224) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:36:00 devstack cinder-volume[89224]: INFO cinder.volume.manager [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Driver initialization completed successfully. Sep 05 04:36:00 devstack cinder-volume[89224]: INFO cinder.manager [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Initiating service 3 cleanup Sep 05 04:36:00 devstack cinder-volume[89224]: INFO cinder.manager [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Service 3 cleanup completed. Sep 05 04:36:00 devstack cinder-volume[89224]: DEBUG cinder.service [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Creating RPC server for service cinder-volume {{(pid=89224) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 04:36:00 devstack cinder-volume[89224]: DEBUG cinder.service [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89224) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 04:36:00 devstack cinder-volume[89224]: INFO cinder.volume.manager [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 05 04:36:00 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:36:00 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:36:00 devstack cinder-volume[89224]: DEBUG cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89224) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:36:00 devstack cinder-volume[89224]: DEBUG cinder.volume.drivers.quobyte [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89224) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:36:00 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:36:00 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:36:00 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:36:00 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:36:00 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Sep 05 04:36:00 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.265s {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:36:00 devstack cinder-volume[89224]: INFO cinder.volume.manager [None req-c336ea75-de0e-41f7-8d9e-8851b8e94d10 None None] Driver post RPC initialization completed successfully. Sep 05 04:36:04 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-a22bb305-b234-4236-bd39-cda40cd8c483 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:36:04 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-a22bb305-b234-4236-bd39-cda40cd8c483 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:36:04 devstack cinder-volume[89224]: DEBUG cinder.volume.drivers.quobyte [None req-a22bb305-b234-4236-bd39-cda40cd8c483 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89224) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:36:04 devstack cinder-volume[89224]: DEBUG cinder.volume.drivers.quobyte [None req-a22bb305-b234-4236-bd39-cda40cd8c483 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89224) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:36:04 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-a22bb305-b234-4236-bd39-cda40cd8c483 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89224) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:36:04 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-a22bb305-b234-4236-bd39-cda40cd8c483 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:36:04 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:36:04 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:36:04 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Sep 05 04:36:04 devstack cinder-volume[89224]: DEBUG oslo_concurrency.processutils [None req-a22bb305-b234-4236-bd39-cda40cd8c483 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.241s {{(pid=89224) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:36:04 devstack cinder-volume[89224]: DEBUG cinder.manager [None req-a22bb305-b234-4236-bd39-cda40cd8c483 None None] Notifying Schedulers of capabilities ... {{(pid=89224) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:36:05 devstack cinder-volume[89007]: INFO oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Caught SIGTERM, stopping children Sep 05 04:36:05 devstack cinder-volume[89007]: DEBUG oslo_concurrency.lockutils [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Acquiring lock "singleton_lock" {{(pid=89007) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 04:36:05 devstack cinder-volume[89007]: DEBUG oslo_concurrency.lockutils [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Acquired lock "singleton_lock" {{(pid=89007) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 04:36:05 devstack cinder-volume[89007]: DEBUG oslo_concurrency.lockutils [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Releasing lock "singleton_lock" {{(pid=89007) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 04:36:05 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Stop services. {{(pid=89007) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 05 04:36:05 devstack cinder-volume[89007]: DEBUG oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Killing children. {{(pid=89007) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 05 04:36:05 devstack cinder-volume[89007]: INFO oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Waiting on 1 children to exit Sep 05 04:36:08 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Acquiring lock "singleton_lock" {{(pid=89224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 04:36:08 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Acquired lock "singleton_lock" {{(pid=89224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 04:36:08 devstack cinder-volume[89224]: DEBUG oslo_concurrency.lockutils [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Releasing lock "singleton_lock" {{(pid=89224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 04:36:08 devstack cinder-volume[89224]: WARNING amqp [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 04:36:08 devstack cinder-volume[89224]: WARNING amqp [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 04:36:08 devstack cinder-volume[89007]: INFO oslo_service.backend._eventlet.service [None req-67eff9c9-b76e-419c-bdee-098accd9a0be None None] Child 89224 exited with status 0 Sep 05 04:36:09 devstack cinder-volume[89508]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 04:36:09 devstack cinder-volume[89508]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 04:36:09 devstack cinder-volume[89508]: we strongly recommend against using it for new projects. Sep 05 04:36:09 devstack cinder-volume[89508]: If you are already using Eventlet, we recommend migrating to a different Sep 05 04:36:09 devstack cinder-volume[89508]: framework. For more detail see Sep 05 04:36:09 devstack cinder-volume[89508]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 04:36:09 devstack cinder-volume[89508]: import eventlet # noqa Sep 05 04:36:12 devstack cinder-volume[89508]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=89508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 04:36:12 devstack cinder-volume[89508]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=89508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 04:36:12 devstack cinder-volume[89508]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=89508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 04:36:12 devstack cinder-volume[89508]: INFO dbcounter [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Registered counter for database cinder Sep 05 04:36:12 devstack cinder-volume[89508]: DEBUG oslo_db.sqlalchemy.engines [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89508) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG dbcounter [-] [89508] Writer thread running {{(pid=89508) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 04:36:13 devstack cinder-volume[89508]: INFO cinder.rpc [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 04:36:13 devstack cinder-volume[89508]: INFO cinder.rpc [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_db.sqlalchemy.engines [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89508) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:36:13 devstack cinder-volume[89508]: INFO cinder.volume.manager [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Determined volume DB was empty at startup. Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG cinder.volume.manager [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=89508) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 04:36:13 devstack cinder-volume[89508]: WARNING stevedore.named [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 04:36:13 devstack cinder-volume[89508]: WARNING castellan.key_manager [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 04:36:13 devstack cinder-volume[89508]: WARNING cinder.keymgr.conf_key_mgr [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 04:36:13 devstack cinder-volume[89508]: INFO cinder.volume.manager [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_db.sqlalchemy.engines [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89508) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:36:13 devstack cinder-volume[89508]: INFO oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Starting 1 workers Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Started child 89807 {{(pid=89508) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Full set of CONF: {{(pid=89508) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] ******************************************************************************** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] Configuration options gathered from: {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] ================================================================================ {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] allow_availability_zone_fallback = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] allow_compression_on_image_upload = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] allowed_direct_url_schemes = [] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] api_rate_limit = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] auth_strategy = keystone {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_availability_zone = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_host = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_name = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_stats_polling_interval = 60 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backup_api_class = cinder.backup.api.API {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89807]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backup_name_template = backup-%s {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backup_use_same_host = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backup_use_temp_snapshot = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] chap_password = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] chap_username = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cinder_internal_tenant_project_id = 53a402bb864d413494b8e61c8c4bc662 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cinder_internal_tenant_user_id = 554b37c9cb7a4ce092c7a2635078060f {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cluster = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] compression_format = gzip {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] compute_api_class = cinder.compute.nova.API {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] config_dir = [] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] config_source = [] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] control_exchange = openstack {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] debug = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] default_availability_zone = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] default_group_type = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] default_volume_type = QuobyteHD {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] disk_geometry = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] driver_client_cert = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] driver_client_cert_key = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] driver_data_namespace = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] driver_ssl_cert_path = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] driver_ssl_cert_verify = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] driver_use_ssl = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] enable_new_services = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] enable_unsupported_driver = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] enabled_backends = ['QuobyteHD'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] enforce_multipath_for_image_xfer = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] filter_function = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance_api_insecure = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance_api_ssl_compression = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance_ca_certificates_file = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance_catalog_info = image:glance:publicURL {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance_certfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance_keyfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance_num_retries = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance_request_timeout = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] goodness_function = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] graceful_shutdown_timeout = 5 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] group_api_class = cinder.group.api.API {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] host = devstack {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] image_compress_on_upload = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] image_conversion_address_space_limit = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] image_conversion_cpu_limit = 60 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] image_conversion_disable = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] image_upload_use_cinder_backend = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] image_upload_use_internal_tenant = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] image_volume_cache_enabled = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] image_volume_cache_max_count = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] image_volume_cache_max_size_gb = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] init_host_max_objects_retrieval = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] instance_format = [instance: %(uuid)s] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] iscsi_target_flags = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] iscsi_write_cache = on {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] iser_helper = tgtadm {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] iser_ip_address = 192.168.122.229 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] iser_port = 3260 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] log_color = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] log_config_append = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] log_dir = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] log_file = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] log_options = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] log_rotate_interval = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] log_rotate_interval_type = days {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] log_rotation_type = none {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] max_age = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] max_logfile_count = 30 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] max_logfile_size_mb = 200 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] max_over_subscription_ratio = 20.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] message_reap_interval = 86400 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] message_ttl = 2592000 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] migration_create_volume_timeout_secs = 300 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] monkey_patch = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] monkey_patch_modules = [] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] my_ip = 192.168.122.229 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] no_snapshot_gb_quota = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Starting volume driver QuobyteDriver (1.2.1) Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] num_iser_scan_tries = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] num_shell_tries = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] num_volume_device_scan_tries = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] nvmeof_conn_info_version = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89807) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] nvmet_ns_id = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] nvmet_port_id = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] osapi_max_limit = 1000 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] osapi_volume_ext_list = [] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] osapi_volume_listen = 0.0.0.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] osapi_volume_listen_port = 8776 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] osapi_volume_use_ssl = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] osapi_volume_workers = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] per_volume_size_limit = -1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] periodic_fuzzy_delay = 60 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] periodic_interval = 60 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] project_id_regex = [0-9a-f\-]+ {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] public_endpoint = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] publish_errors = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] quota_backup_gigabytes = 1000 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] quota_backups = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] quota_gigabytes = 1000 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] quota_groups = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] quota_snapshots = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] quota_volumes = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] rate_limit_burst = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] rate_limit_except_level = CRITICAL {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] rate_limit_interval = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] reinit_driver_count = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] replication_device = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] report_discard_supported = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] report_interval = 120 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] reservation_clean_interval = 86400 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] reservation_expire = 86400 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] reserved_image_namespaces = [] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] reserved_percentage = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] rpc_response_timeout = 120 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] run_external_periodic_tasks = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] scst_target_driver = iscsi {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] scst_target_iqn_name = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_down_time = 720 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] shell_completion = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] snapshot_name_template = snapshot-%s {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] split_loggers = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] state_path = /opt/stack/data/cinder {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] storage_availability_zone = nova {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] storage_protocol = iSCSI {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] syslog_log_facility = LOG_USER {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] target_helper = lioadm {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] target_ip_address = 192.168.122.229 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] target_port = 3260 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] target_protocol = iscsi {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] target_secondary_ip_addresses = [] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] trace_flags = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] transfer_api_class = cinder.transfer.api.API {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] transport_url = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] until_refresh = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] use_chap_auth = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] use_default_quota_class = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] use_journal = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] use_json = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] use_multipath_for_image_xfer = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] use_stderr = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] use_syslog = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] verify_glance_signatures = enabled {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_api_class = cinder.volume.api.API {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_backend_name = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_clear = zero {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_clear_ionice = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_clear_size = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_copy_bps_limit = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_dd_blocksize = 1M {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_name_template = volume-%s {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_service_inithost_offload = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volume_usage_audit_period = month {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] zoning_mode = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_concurrency.disable_process_locking = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.auth_section = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.auth_type = password {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.auth_version = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.cache = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.certfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.delay_auth_decision = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.http_connect_timeout = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.include_service_catalog = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.insecure = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.interface = public {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.keyfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_password = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89807) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 05 04:36:13 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.quobyte [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcache_username = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.quobyte [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.region_name = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Running cmd (subprocess): mount.quobyte {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.service_token_roles_required = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.service_type = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.token_cache_time = 300 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.backend = dogpile.cache.null {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.backend_argument = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.backend_expiration_time = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.config_prefix = cache.oslo {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.debug_cache_backend = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.enable_retry_client = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.enable_socket_keepalive = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.enabled = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.expiration_time = 600 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.hashclient_retry_attempts = 2 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.memcache_dead_retry = 300 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.memcache_pool_maxsize = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.memcache_sasl_enabled = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.password = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.proxies = [] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.redis_db = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.redis_sentinel_service_name = mymaster {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.redis_server = localhost:6379 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.retry_attempts = 2 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.retry_delay = 0.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.socket_keepalive_count = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.socket_keepalive_idle = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.socket_keepalive_interval = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.socket_timeout = 1.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.tls_allowed_ciphers = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.tls_cafile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.tls_certfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.tls_enabled = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.tls_keyfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cache.username = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] coordination.backend_url = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.asyncio_connection = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.asyncio_slave_connection = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.backend = sqlalchemy {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.connection = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.connection_debug = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.connection_parameters = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.connection_recycle_time = 3600 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.connection_trace = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.db_inc_retry_interval = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.db_max_retries = 20 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.db_max_retry_interval = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.db_retry_interval = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.max_overflow = 50 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.max_pool_size = 5 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.max_retries = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.mysql_wsrep_sync_wait = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.pool_timeout = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.retry_interval = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.slave_connection = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.sqlite_synchronous = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.synchronous_reader = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] database.use_db_reconnect = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack quobyte-client[89808]: Reading configuration file: /etc/quobyte/client.cfg Sep 05 04:36:13 devstack quobyte-client[89808]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_tracing.insecure = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.connection_string = messaging:// {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.enabled = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.es_doc_type = notification {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.es_scroll_size = 10000 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.es_scroll_time = 2m {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.filter_error_trace = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.hmac_keys = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.sentinel_service_name = mymaster {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.socket_timeout = 0.1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.trace_requests = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler.trace_sqlalchemy = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler_jaeger.process_tags = {} {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler_jaeger.service_name_prefix = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] profiler_otlp.service_name_prefix = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_policy.enforce_new_defaults = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_policy.policy_default_rule = default {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_policy.policy_file = policy.yaml {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_policy.remote_timeout = 60.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] privsep_osbrick.group = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] privsep_osbrick.helper_command = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] privsep_osbrick.user = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cinder_sys_admin.group = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cinder_sys_admin.helper_command = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] cinder_sys_admin.user = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.auth_section = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.auth_type = password {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.cafile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.certfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.collect_timing = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.insecure = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.keyfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.send_service_user_token = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.split_loggers = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.timeout = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.tls_ciphers = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] service_user.tls_min_version = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.auth_section = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.auth_type = password {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.certfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.collect_timing = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.insecure = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.keyfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.region_name = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.split_loggers = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.timeout = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.tls_ciphers = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] glance.tls_min_version = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.backend_availability_zone = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.chap_password = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.chap_username = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.disk_geometry = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.driver_client_cert = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.driver_client_cert_key = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.driver_data_namespace = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.driver_use_ssl = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.enable_unsupported_driver = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.extra_capabilities = {} {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.filter_function = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.goodness_function = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.iscsi_target_flags = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.iscsi_write_cache = on {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.iser_helper = tgtadm {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.iser_port = 3260 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nas_host = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nas_login = admin {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nas_mount_options = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nas_password = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nas_private_key = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nas_share_path = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nas_ssh_port = 22 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.num_shell_tries = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:36:13 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.nvmet_port_id = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.quobyte_client_cfg = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.quobyte_volume_url = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.replication_device = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.report_discard_supported = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.reserved_percentage = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.scst_target_driver = iscsi {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.scst_target_iqn_name = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.storage_protocol = iSCSI {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.target_helper = tgtadm {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.target_port = 3260 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.target_protocol = iscsi {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.trace_flags = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.unique_fqdn_network = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.use_chap_auth = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.volume_backend_name = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.volume_clear = zero {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.volume_clear_ionice = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.volume_clear_size = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_reports.file_event_handler = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_reports.log_dir = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.backend_availability_zone = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.backend_host = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.chap_password = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.chap_username = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.chiscsi_conf = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.disk_geometry = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.driver_client_cert = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.driver_client_cert_key = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.driver_data_namespace = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.driver_use_ssl = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.enable_unsupported_driver = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.extra_capabilities = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.filter_function = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.goodness_function = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.iscsi_target_flags = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.iscsi_write_cache = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.iser_helper = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.iser_ip_address = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.iser_port = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.iser_target_prefix = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nas_host = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nas_login = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nas_mount_options = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nas_password = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nas_private_key = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nas_share_path = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nas_ssh_port = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.num_shell_tries = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nvmet_ns_id = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.nvmet_port_id = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.replication_device = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.report_discard_supported = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.reserved_percentage = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.scst_target_driver = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.storage_protocol = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.target_helper = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.target_ip_address = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.target_port = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.target_prefix = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.target_protocol = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.trace_flags = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.unique_fqdn_network = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.use_chap_auth = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.volume_clear = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.volume_clear_ionice = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.volume_clear_size = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] QuobyteHD.volumes_dir = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.ssl = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.ssl_version = {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_notifications.driver = [] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_notifications.retry = -1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] oslo_messaging_notifications.transport_url = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] key_manager.fixed_key = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.barbican_api_version = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.barbican_endpoint = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.barbican_endpoint_type = public {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.barbican_region_name = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.cafile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.certfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.collect_timing = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.insecure = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.keyfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.number_of_retries = 60 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.retry_delay = 1 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.send_service_user_token = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.split_loggers = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.timeout = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.tls_ciphers = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.tls_min_version = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.verify_ssl = True {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican.verify_ssl_path = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.auth_section = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.auth_type = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.cafile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.certfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.collect_timing = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.insecure = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.keyfile = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.split_loggers = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.timeout = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.tls_ciphers = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] barbican_service_user.tls_min_version = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.approle_role_id = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.approle_secret_id = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.auth_method = approle {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.auth_path = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.kv_mountpoint = secret {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.kv_path = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.kv_version = 2 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.namespace = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.root_token_id = **** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.ssl_ca_crt_file = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.timeout = 60.0 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.token_file = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.token_role = None {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.use_ssl = False {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 04:36:13 devstack cinder-volume[89508]: DEBUG oslo_service.backend._eventlet.service [None req-fa93aab5-852a-48c6-9b4d-2ec73e5b0ffa None None] ******************************************************************************** {{(pid=89508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 04:36:13 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.266s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:36:13 devstack cinder-volume[89807]: INFO cinder.volume.driver [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Driver hasn't implemented _init_vendor_properties() Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG cinder.volume.driver [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7087516784668, 'free_capacity_gb': 1773.7087516784668, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89807) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_db.sqlalchemy.engines [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89807) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writer thread running {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG cinder.db.api [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Building query based on filter {{(pid=89807) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89807) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:36:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:36:13 devstack cinder-volume[89807]: INFO cinder.keymgr.migration [None req-52f2d039-2741-4a94-b60e-bb291de46948 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 04:36:13 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:36:14 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:36:14 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:36:14 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Driver initialization completed successfully. Sep 05 04:36:14 devstack cinder-volume[89807]: INFO cinder.manager [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Initiating service 3 cleanup Sep 05 04:36:14 devstack cinder-volume[89807]: INFO cinder.manager [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Service 3 cleanup completed. Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG cinder.service [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Creating RPC server for service cinder-volume {{(pid=89807) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG cinder.service [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89807) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 04:36:14 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:36:14 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:36:14 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:36:14 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Sep 05 04:36:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.239s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:36:14 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3b42591e-ed37-44bb-adc6-c6789e4dccdb None None] Driver post RPC initialization completed successfully. Sep 05 04:36:23 devstack cinder-volume[89508]: DEBUG dbcounter [-] [89508] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=89508) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:36:24 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:36:24 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=3 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:37:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:37:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 6 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:37:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:37:40 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Flow 'volume_create_manager' (92382050-f83c-41d2-8e30-fdd39e1ab823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41108dd3-b2b8-4d94-a777-6c0b7a4082b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41108dd3-b2b8-4d94-a777-6c0b7a4082b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-121647108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e060f64c-9e62-4cc8-a1d8-c71af9395359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af76fc6b6f364c9eb57cf439f30277b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:37:41Z,use_quota=True,user_id='dd1cb29addae482da93020e26058ef60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253637ca-0cb9-4518-af5c-bc91da57a3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253637ca-0cb9-4518-af5c-bc91da57a3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82e8e62-fd15-4225-a614-5944bab3317d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82e8e62-fd15-4225-a614-5944bab3317d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e060f64c-9e62-4cc8-a1d8-c71af9395359', 'volume_name': 'volume-e060f64c-9e62-4cc8-a1d8-c71af9395359', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d7c74e-7e99-438e-be6b-1a063887e2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d7c74e-7e99-438e-be6b-1a063887e2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a38a1be-2ff2-40b6-90e2-f46d826fd585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Volume e060f64c-9e62-4cc8-a1d8-c71af9395359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e060f64c-9e62-4cc8-a1d8-c71af9395359', 'volume_size': 1} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-121647108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e060f64c-9e62-4cc8-a1d8-c71af9395359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af76fc6b6f364c9eb57cf439f30277b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:37:41Z,use_quota=True,user_id='dd1cb29addae482da93020e26058ef60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Creating volume e060f64c-9e62-4cc8-a1d8-c71af9395359 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:37:41 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:37:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:37:41 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359 1073741824 Sep 05 04:37:41 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:37:42 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Sep 05 04:37:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359 1073741824" returned: 0 in 1.666s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:37:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:37:43 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359 Sep 05 04:37:43 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:37:44 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359" returned: 0 in 1.002s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.823s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Flow 'volume_create_manager' (9f2fcf22-ca26-4e65-9923-38b22d09f316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad265831-2821-4c9e-b1ef-1905fcb5b939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a38a1be-2ff2-40b6-90e2-f46d826fd585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e060f64c-9e62-4cc8-a1d8-c71af9395359', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0332386c-6152-47f9-a56b-f6bb277e67f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad265831-2821-4c9e-b1ef-1905fcb5b939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-532637913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7964315-9220-440f-872d-d5323210d030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b3f6b1d115439a8c6b245443f6c78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:37:44Z,use_quota=True,user_id='4349c064e58a410ba4d8d002b5e0df0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fef5ee-f223-4435-be7f-5eac490ef703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fef5ee-f223-4435-be7f-5eac490ef703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e13406-d886-460d-92e8-4ba0aae3a2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e13406-d886-460d-92e8-4ba0aae3a2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7964315-9220-440f-872d-d5323210d030', 'volume_name': 'volume-e7964315-9220-440f-872d-d5323210d030', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f4b3d0-4088-45f0-b6ef-68d9514abae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f4b3d0-4088-45f0-b6ef-68d9514abae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574f2f00-78b4-421e-9e41-3a4cba119861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:44 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Volume e7964315-9220-440f-872d-d5323210d030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7964315-9220-440f-872d-d5323210d030', 'volume_size': 1} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-532637913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7964315-9220-440f-872d-d5323210d030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b3f6b1d115439a8c6b245443f6c78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:37:44Z,use_quota=True,user_id='4349c064e58a410ba4d8d002b5e0df0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Creating volume e7964315-9220-440f-872d-d5323210d030 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:37:44 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:37:44 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Volume volume-e060f64c-9e62-4cc8-a1d8-c71af9395359 (e060f64c-9e62-4cc8-a1d8-c71af9395359): created successfully Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0332386c-6152-47f9-a56b-f6bb277e67f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:44 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030 1073741824 Sep 05 04:37:44 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:37:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Flow 'volume_create_manager' (92382050-f83c-41d2-8e30-fdd39e1ab823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:37:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a5a6c3d6-11ac-42f9-a234-56a49c4399ec tempest-VolumesAdminNegativeTest-1340980583 None] Created volume successfully. Sep 05 04:37:45 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Sep 05 04:37:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030 1073741824" returned: 0 in 0.875s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:37:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:37:45 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030 Sep 05 04:37:45 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:37:45 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Sep 05 04:37:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030" returned: 0 in 0.447s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:37:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:37:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:37:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574f2f00-78b4-421e-9e41-3a4cba119861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7964315-9220-440f-872d-d5323210d030', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac50546-bcad-4173-9a3c-d0ab1afb470b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:46 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Volume volume-e7964315-9220-440f-872d-d5323210d030 (e7964315-9220-440f-872d-d5323210d030): created successfully Sep 05 04:37:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac50546-bcad-4173-9a3c-d0ab1afb470b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Flow 'volume_create_manager' (9f2fcf22-ca26-4e65-9923-38b22d09f316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:37:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-756aae6b-1df5-4ee2-b6e8-d3c315fd094d tempest-ServerRescueNegativeTestJSON-959043052 None] Created volume successfully. Sep 05 04:37:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Acquiring lock "cinder-e060f64c-9e62-4cc8-a1d8-c71af9395359-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:37:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Lock "cinder-e060f64c-9e62-4cc8-a1d8-c71af9395359-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:37:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Acquiring lock "cinder-quobyte-e060f64c-9e62-4cc8-a1d8-c71af9395359" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:37:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Lock "cinder-quobyte-e060f64c-9e62-4cc8-a1d8-c71af9395359" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:37:46 devstack cinder-volume[89807]: INFO oslo.privsep.daemon [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkb3iehwl/privsep.sock'] Sep 05 04:37:46 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkb3iehwl/privsep.sock Sep 05 04:37:46 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:37:48 devstack cinder-volume[89807]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 05 04:37:48 devstack cinder-volume[89807]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 04:37:48 devstack cinder-volume[89807]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 05 04:37:48 devstack cinder-volume[89807]: WARNING oslo.privsep.daemon [-] privsep log: Sep 05 04:37:48 devstack cinder-volume[89807]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 05 04:37:48 devstack cinder-volume[89807]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 05 04:37:48 devstack cinder-volume[89807]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 04:37:48 devstack cinder-volume[89807]: WARNING oslo.privsep.daemon [-] privsep log: Sep 05 04:37:48 devstack cinder-volume[89807]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 05 04:37:48 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 05 04:37:48 devstack cinder-volume[89807]: INFO oslo.privsep.daemon [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Spawned new privsep daemon via rootwrap Sep 05 04:37:48 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Accepted privsep connection to /tmp/tmpkb3iehwl/privsep.sock {{(pid=89807) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 05 04:37:48 devstack cinder-volume[89807]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 05 04:37:48 devstack cinder-volume[89807]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 05 04:37:48 devstack cinder-volume[89807]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 05 04:37:48 devstack cinder-volume[89807]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91079 Sep 05 04:37:48 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6329634-5446-47be-b677-cacf139d5082]: (2,) {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:37:48 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27e52c1-a559-4a36-abfe-7134a6cc984c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:37:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:37:48 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359 Sep 05 04:37:48 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:37:49 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Sep 05 04:37:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359" returned: 0 in 0.828s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:37:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:37:49 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359 Sep 05 04:37:49 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:37:49 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Sep 05 04:37:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e060f64c-9e62-4cc8-a1d8-c71af9395359" returned: 0 in 0.513s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:37:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Lock "cinder-quobyte-e060f64c-9e62-4cc8-a1d8-c71af9395359" released by "delete_volume" :: held 3.187s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:37:49 devstack cinder-volume[89807]: WARNING cinder.quota [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:37:49 devstack cinder-volume[89807]: WARNING cinder.quota [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:37:50 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Created reservations ['3cd93ca8-4b34-4ed9-8a59-bc3b1a9278ce', '176af662-75e1-4427-b8d1-c4e6d04815e7', 'c5b97ef5-8da9-4521-bc4c-8112f98bf8bf', 'b144bd73-72e2-4002-9cd8-1db659b43a22'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:37:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:37:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:37:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:37:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:37:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:37:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:37:50 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:37:50 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:37:50 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Sep 05 04:37:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.421s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:37:50 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:37:50 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Deleted volume successfully. Sep 05 04:37:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-566cd7ea-780c-4a06-a148-7209961667d8 tempest-VolumesAdminNegativeTest-1340980583 None] Lock "cinder-e060f64c-9e62-4cc8-a1d8-c71af9395359-delete_volume" released by "delete_volume" :: held 4.230s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Flow 'volume_create_manager' (bfd01719-45b2-4f0d-9a93-707dab647d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac5c06f-ff6b-4068-90eb-2d7472ce2117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac5c06f-ff6b-4068-90eb-2d7472ce2117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-505038094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aad1de-d3b7-464d-aa49-0faa9708e479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505acc7be7fc427f9f67a3ec3c785699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:37:56Z,use_quota=True,user_id='3a24f0f95fa345c39606e0f6e66e338c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b431aa-db85-4665-b857-3021b42865dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b431aa-db85-4665-b857-3021b42865dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29481bc1-c155-4352-9f6b-b5a2f57d50a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29481bc1-c155-4352-9f6b-b5a2f57d50a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91aad1de-d3b7-464d-aa49-0faa9708e479', 'volume_name': 'volume-91aad1de-d3b7-464d-aa49-0faa9708e479', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc050445-2730-465d-a2db-94a3963fb0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc050445-2730-465d-a2db-94a3963fb0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e870c6-ce14-41de-ab87-6a893a37c3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:56 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Volume 91aad1de-d3b7-464d-aa49-0faa9708e479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91aad1de-d3b7-464d-aa49-0faa9708e479', 'volume_size': 1} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-505038094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aad1de-d3b7-464d-aa49-0faa9708e479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505acc7be7fc427f9f67a3ec3c785699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:37:56Z,use_quota=True,user_id='3a24f0f95fa345c39606e0f6e66e338c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Creating volume 91aad1de-d3b7-464d-aa49-0faa9708e479 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:37:56 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:37:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:37:56 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479 1073741824 Sep 05 04:37:56 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:37:57 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Sep 05 04:37:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479 1073741824" returned: 0 in 0.922s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:37:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:37:57 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479 Sep 05 04:37:57 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:37:57 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Sep 05 04:37:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479" returned: 0 in 0.531s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:37:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:37:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:37:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e870c6-ce14-41de-ab87-6a893a37c3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91aad1de-d3b7-464d-aa49-0faa9708e479', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f7d088-7f83-4f9c-8150-4a6d77bcf2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:37:57 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Volume volume-91aad1de-d3b7-464d-aa49-0faa9708e479 (91aad1de-d3b7-464d-aa49-0faa9708e479): created successfully Sep 05 04:37:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f7d088-7f83-4f9c-8150-4a6d77bcf2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:37:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Flow 'volume_create_manager' (bfd01719-45b2-4f0d-9a93-707dab647d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:37:58 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5465ec91-1a47-4580-92b6-dfe51dd7298b tempest-AttachVolumeShelveTestJSON-99853331 None] Created volume successfully. Sep 05 04:38:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Acquiring lock "cinder-e7964315-9220-440f-872d-d5323210d030-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:38:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Lock "cinder-e7964315-9220-440f-872d-d5323210d030-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:38:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Acquiring lock "cinder-quobyte-e7964315-9220-440f-872d-d5323210d030" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:38:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Lock "cinder-quobyte-e7964315-9220-440f-872d-d5323210d030" acquired by "delete_volume" :: waited 0.046s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:38:07 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[394d5ab9-9873-4ca5-a9f3-346a24087b3c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:38:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:38:07 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030 Sep 05 04:38:07 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:38:07 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Sep 05 04:38:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030" returned: 0 in 0.845s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:38:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:38:07 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030 Sep 05 04:38:07 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:38:08 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Sep 05 04:38:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e7964315-9220-440f-872d-d5323210d030" returned: 0 in 0.592s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:38:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Lock "cinder-quobyte-e7964315-9220-440f-872d-d5323210d030" released by "delete_volume" :: held 1.531s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:38:08 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Created reservations ['16b8848f-3335-43de-919f-3145b8cc863c', 'f04e9952-1f09-43f9-b191-08fba50f730b', '5500063b-6d38-450c-a3af-eaf453fce5c9', 'f58e28a0-5d43-41fd-91b1-c12dc7167178'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:38:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:38:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:38:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:38:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:38:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:38:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:38:08 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:38:08 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:38:09 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Sep 05 04:38:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:38:09 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:38:09 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Deleted volume successfully. Sep 05 04:38:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-675b73c2-2ea6-4639-b07a-ace9890bd3fd tempest-ServerRescueNegativeTestJSON-959043052 None] Lock "cinder-e7964315-9220-440f-872d-d5323210d030-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:38:10 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:38:10 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:38:10 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.339s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 8 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:38:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:38:17 devstack cinder-volume[89807]: WARNING py.warnings [req-313ccfa3-b781-4d44-aa30-3e68cbda5624 req-fa8d0e63-d4d7-41cb-a7c3-4434fc67cf13 tempest-AttachVolumeShelveTestJSON-99853331 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 05 04:38:17 devstack cinder-volume[89807]: .first() Sep 05 04:38:17 devstack cinder-volume[89807]: Sep 05 04:38:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-313ccfa3-b781-4d44-aa30-3e68cbda5624 req-fa8d0e63-d4d7-41cb-a7c3-4434fc67cf13 tempest-AttachVolumeShelveTestJSON-99853331 None] No connector for attachment 7b4c9de7-6c1e-44c4-8314-8a27b4c8cb44; skipping storage backend terminate_connection call. {{(pid=89807) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 05 04:38:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-313ccfa3-b781-4d44-aa30-3e68cbda5624 req-fa8d0e63-d4d7-41cb-a7c3-4434fc67cf13 tempest-AttachVolumeShelveTestJSON-99853331 None] Deleting attachment 7b4c9de7-6c1e-44c4-8314-8a27b4c8cb44. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:38:27 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=18,cinder:UPDATE=30,cinder:INSERT=5,cinder:DELETE=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:38:27 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=4 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Flow 'volume_create_manager' (0c3f4672-8841-4c8d-80e1-ec5a8cec34e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d764a21-840f-4217-8330-1cda577d78a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d764a21-840f-4217-8330-1cda577d78a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-282777655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd37196-1192-46d6-92c0-9b9196da4fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cd54eedc9a4fe199c7820836d177c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:38:53Z,use_quota=True,user_id='a9f659bfe482467f9ff74dad4286e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8bf78c-cfc6-4ac0-86bf-c039abf74f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8bf78c-cfc6-4ac0-86bf-c039abf74f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60392d76-8f0d-41d7-9dbe-5e13f264937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60392d76-8f0d-41d7-9dbe-5e13f264937a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd37196-1192-46d6-92c0-9b9196da4fb5', 'volume_name': 'volume-8bd37196-1192-46d6-92c0-9b9196da4fb5', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca716ba0-63a3-4b7b-8a12-3ef131289cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca716ba0-63a3-4b7b-8a12-3ef131289cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0aa9a2-9969-4864-a7e4-058c3928b205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:38:53 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Volume 8bd37196-1192-46d6-92c0-9b9196da4fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd37196-1192-46d6-92c0-9b9196da4fb5', 'volume_size': 1} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-282777655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd37196-1192-46d6-92c0-9b9196da4fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cd54eedc9a4fe199c7820836d177c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:38:53Z,use_quota=True,user_id='a9f659bfe482467f9ff74dad4286e263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Creating volume 8bd37196-1192-46d6-92c0-9b9196da4fb5 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:38:53 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:38:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:38:53 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5 1073741824 Sep 05 04:38:53 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:38:54 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Sep 05 04:38:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5 1073741824" returned: 0 in 0.843s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:38:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:38:54 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5 Sep 05 04:38:54 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:38:54 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Sep 05 04:38:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5" returned: 0 in 0.325s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:38:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:38:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:38:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0aa9a2-9969-4864-a7e4-058c3928b205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd37196-1192-46d6-92c0-9b9196da4fb5', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:38:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29921d9e-0e06-46fb-9530-73ba11b33a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:38:54 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Volume volume-8bd37196-1192-46d6-92c0-9b9196da4fb5 (8bd37196-1192-46d6-92c0-9b9196da4fb5): created successfully Sep 05 04:38:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29921d9e-0e06-46fb-9530-73ba11b33a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:38:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Flow 'volume_create_manager' (0c3f4672-8841-4c8d-80e1-ec5a8cec34e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:38:54 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-843b14c6-8192-48ce-ab77-0544712b34ab tempest-TaggedAttachmentsTest-1601119526 None] Created volume successfully. Sep 05 04:39:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Acquiring lock "cinder-91aad1de-d3b7-464d-aa49-0faa9708e479-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Lock "cinder-91aad1de-d3b7-464d-aa49-0faa9708e479-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Acquiring lock "cinder-quobyte-91aad1de-d3b7-464d-aa49-0faa9708e479" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Lock "cinder-quobyte-91aad1de-d3b7-464d-aa49-0faa9708e479" acquired by "delete_volume" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:04 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ca39d4-4f22-4ab2-98e5-1358a7cef406]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:04 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479 Sep 05 04:39:04 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:04 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479" returned: 0 in 0.741s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:04 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479 Sep 05 04:39:04 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:05 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-91aad1de-d3b7-464d-aa49-0faa9708e479" returned: 0 in 0.937s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Lock "cinder-quobyte-91aad1de-d3b7-464d-aa49-0faa9708e479" released by "delete_volume" :: held 1.765s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Created reservations ['4a503fa9-f192-4265-b2f9-2cdab4b889d5', 'bc2c22bc-06ef-4e11-8db9-a2c18acc9a17', '81cf21ac-02f1-4ab9-800e-d0d0609d6b86', '0dea4b0b-265e-4aac-a288-f65752cc8e65'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:06 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:39:06 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Flow 'volume_create_manager' (84ea630e-0ba1-40f5-bbac-6f44e0152638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001aa5a0-a334-4a4e-a9b7-cea7b2c84f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001aa5a0-a334-4a4e-a9b7-cea7b2c84f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2104657157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9560e6433f4849d8ba55b8cc186cd226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:06Z,use_quota=True,user_id='7974c115cdb84e499312c2fba127f58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42358c9d-9c41-48e1-9de1-649c1ad2f132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42358c9d-9c41-48e1-9de1-649c1ad2f132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715397ce-ddde-41b2-a2c2-3557bb361de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715397ce-ddde-41b2-a2c2-3557bb361de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8', 'volume_name': 'volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e93859-5001-4aab-952c-1e59c3308f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e93859-5001-4aab-952c-1e59c3308f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5324477-db93-4da0-b73f-27775460469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:06 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Volume faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8', 'volume_size': 1} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2104657157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9560e6433f4849d8ba55b8cc186cd226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:06Z,use_quota=True,user_id='7974c115cdb84e499312c2fba127f58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Creating volume faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:39:06 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:39:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:07 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 1073741824 Sep 05 04:39:07 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:07 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.983s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:07 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:39:07 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Deleted volume successfully. Sep 05 04:39:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-86aacd77-e463-44cb-a621-10975fd3a37a tempest-AttachVolumeShelveTestJSON-99853331 None] Lock "cinder-91aad1de-d3b7-464d-aa49-0faa9708e479-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:08 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 1073741824" returned: 0 in 1.190s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:08 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 Sep 05 04:39:08 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:08 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8" returned: 0 in 0.535s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:39:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5324477-db93-4da0-b73f-27775460469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c2f283-488f-47f5-bf33-653171466525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:08 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Volume volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 (faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8): created successfully Sep 05 04:39:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c2f283-488f-47f5-bf33-653171466525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Flow 'volume_create_manager' (84ea630e-0ba1-40f5-bbac-6f44e0152638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:09 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-bade639d-5aea-4794-91a8-d646eb5d2347 tempest-DeleteServersTestJSON-1832859632 None] Created volume successfully. Sep 05 04:39:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:39:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:10 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:39:10 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:11 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.860s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:39:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-e9ff267e-4759-4db3-93aa-f71f769a3ebe req-fd7f230f-6fda-4ff5-b487-980b72737e1a tempest-DeleteServersTestJSON-1832859632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-e9ff267e-4759-4db3-93aa-f71f769a3ebe req-fd7f230f-6fda-4ff5-b487-980b72737e1a tempest-DeleteServersTestJSON-1832859632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-e9ff267e-4759-4db3-93aa-f71f769a3ebe req-fd7f230f-6fda-4ff5-b487-980b72737e1a tempest-DeleteServersTestJSON-1832859632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-e9ff267e-4759-4db3-93aa-f71f769a3ebe req-fd7f230f-6fda-4ff5-b487-980b72737e1a tempest-DeleteServersTestJSON-1832859632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bb4651d-ffd6-435e-9bf9-79686bb71b74', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:39:16 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-e9ff267e-4759-4db3-93aa-f71f769a3ebe req-fd7f230f-6fda-4ff5-b487-980b72737e1a tempest-DeleteServersTestJSON-1832859632 None] attachment_update completed successfully. Sep 05 04:39:23 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-1f6f324b-f802-4f50-8833-d8991566ae74 req-7a1df03e-e100-4f51-a838-2f4fbdb4ef7b tempest-DeleteServersTestJSON-1832859632 None] Terminate volume connection completed successfully. Sep 05 04:39:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-1f6f324b-f802-4f50-8833-d8991566ae74 req-7a1df03e-e100-4f51-a838-2f4fbdb4ef7b tempest-DeleteServersTestJSON-1832859632 None] Deleting attachment 9bb4651d-ffd6-435e-9bf9-79686bb71b74. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:39:26 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=15 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:39:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Acquiring lock "cinder-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Lock "cinder-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Acquiring lock "cinder-quobyte-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Lock "cinder-quobyte-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8" acquired by "delete_volume" :: waited 0.040s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b4ffa4-3f8a-42f6-88b4-718beab2712e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:39:27 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 Sep 05 04:39:27 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Flow 'volume_create_manager' (6172554d-ea62-49ee-a678-2ed324705911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ef159c-9e51-4379-a834-ca62f15aa109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ef159c-9e51-4379-a834-ca62f15aa109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1716025654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b765ad77-69a4-4ce9-9afe-f684d4c3e979,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4cf75db332f40cca155d942dc17946b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:27Z,use_quota=True,user_id='3da055edf04e479196413178b811e9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7284c5-aeed-4fb6-ba01-0c68a06cd014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7284c5-aeed-4fb6-ba01-0c68a06cd014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc2d026-5cf7-4bf9-8374-7d203a26a011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc2d026-5cf7-4bf9-8374-7d203a26a011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b765ad77-69a4-4ce9-9afe-f684d4c3e979', 'volume_name': 'volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f2ec9f-9eb4-43fc-a390-8100191c8f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f2ec9f-9eb4-43fc-a390-8100191c8f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed99ca3b-5a1c-4077-a019-8c8affb40c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:27 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Volume b765ad77-69a4-4ce9-9afe-f684d4c3e979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979', 'volume_size': 1} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1716025654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b765ad77-69a4-4ce9-9afe-f684d4c3e979,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4cf75db332f40cca155d942dc17946b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:27Z,use_quota=True,user_id='3da055edf04e479196413178b811e9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Creating volume b765ad77-69a4-4ce9-9afe-f684d4c3e979 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:39:27 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:27 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979 1073741824 Sep 05 04:39:27 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:27 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8" returned: 0 in 0.593s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:27 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8 Sep 05 04:39:27 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:28 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8" returned: 0 in 0.402s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Lock "cinder-quobyte-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8" released by "delete_volume" :: held 1.137s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:28 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979 1073741824" returned: 0 in 0.766s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:28 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979 Sep 05 04:39:28 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Created reservations ['2fe94f68-3dd3-4028-b18c-979dda855966', 'fdbfd97d-5273-4193-b164-441bdf025998', '204a0873-4ce5-422f-9796-b825b0eedbea', '1c82677a-474e-446a-855e-4b71428ec9cb'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:28 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:39:28 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:28 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979" returned: 0 in 0.446s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed99ca3b-5a1c-4077-a019-8c8affb40c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf410d6-7cf6-4008-9226-4179b988a89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:28 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Volume volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979 (b765ad77-69a4-4ce9-9afe-f684d4c3e979): created successfully Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf410d6-7cf6-4008-9226-4179b988a89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:28 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Flow 'volume_create_manager' (6172554d-ea62-49ee-a678-2ed324705911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.352s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:39:28 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Deleted volume successfully. Sep 05 04:39:28 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-35dacf02-c65b-4754-b232-57422d18a972 tempest-VolumesTestJSON-451995854 None] Created volume successfully. Sep 05 04:39:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-44e306e8-82d4-47e8-81c1-11b3e13ce730 tempest-DeleteServersTestJSON-1832859632 None] Lock "cinder-faddab0c-9fb5-4914-80d2-b0ff2eb3e8b8-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Flow 'volume_create_manager' (619ccc21-3b9e-434f-bb19-a8b927611e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5cef55-d0b6-49ce-903c-34e592bd410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5cef55-d0b6-49ce-903c-34e592bd410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-282762305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea51c3d3-8970-4304-81c9-3ec6fc16b2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497f2415941e443ab8d97f2b3ce89fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:29Z,use_quota=True,user_id='fca7be422503441bb907cd6325e23d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c247b92-09e0-4711-9d43-2c3602c4bff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c247b92-09e0-4711-9d43-2c3602c4bff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5129c567-a9d7-4637-84ad-94d67300dd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5129c567-a9d7-4637-84ad-94d67300dd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea51c3d3-8970-4304-81c9-3ec6fc16b2c0', 'volume_name': 'volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48953c4-8e55-4fe2-b645-4f3371a15a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48953c4-8e55-4fe2-b645-4f3371a15a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7607ed6-4615-4760-949c-90dec3962f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Volume ea51c3d3-8970-4304-81c9-3ec6fc16b2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0', 'volume_size': 1} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-282762305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea51c3d3-8970-4304-81c9-3ec6fc16b2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497f2415941e443ab8d97f2b3ce89fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:29Z,use_quota=True,user_id='fca7be422503441bb907cd6325e23d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Creating volume ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:39:29 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:39:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:29 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 1073741824 Sep 05 04:39:29 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Flow 'volume_create_manager' (51a67766-9397-4f4f-bf24-57f746969079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fec9af2-0b2f-42dc-b718-3f621d30c8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:30 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fec9af2-0b2f-42dc-b718-3f621d30c8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2106318299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f84823-b592-4d16-bf71-f72709538241,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4cf75db332f40cca155d942dc17946b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:30Z,use_quota=True,user_id='3da055edf04e479196413178b811e9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f8a537-6371-431d-b103-6226a9c1e655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f8a537-6371-431d-b103-6226a9c1e655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621c666b-5029-4673-ac3a-3e2dee633e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621c666b-5029-4673-ac3a-3e2dee633e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f84823-b592-4d16-bf71-f72709538241', 'volume_name': 'volume-d8f84823-b592-4d16-bf71-f72709538241', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9b3cf1-1cde-4ae4-9385-7129e1205309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9b3cf1-1cde-4ae4-9385-7129e1205309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5059cc8f-1123-4801-8deb-99e505dbd60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Volume d8f84823-b592-4d16-bf71-f72709538241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f84823-b592-4d16-bf71-f72709538241', 'volume_size': 1} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 1073741824" returned: 0 in 0.727s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:30 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 Sep 05 04:39:30 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:30 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0" returned: 0 in 0.286s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2106318299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f84823-b592-4d16-bf71-f72709538241,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4cf75db332f40cca155d942dc17946b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:30Z,use_quota=True,user_id='3da055edf04e479196413178b811e9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Creating volume d8f84823-b592-4d16-bf71-f72709538241 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:39:30 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:30 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241 1073741824 Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7607ed6-4615-4760-949c-90dec3962f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:30 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac17bbc-70cd-4eaa-97fd-9e743e4c5129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Volume volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 (ea51c3d3-8970-4304-81c9-3ec6fc16b2c0): created successfully Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac17bbc-70cd-4eaa-97fd-9e743e4c5129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Flow 'volume_create_manager' (619ccc21-3b9e-434f-bb19-a8b927611e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-098dbd7a-eb6e-4073-8ff1-e0a3df985e93 tempest-ServersNegativeTestJSON-1803127769 None] Created volume successfully. Sep 05 04:39:31 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241 1073741824" returned: 0 in 0.451s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:31 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241 Sep 05 04:39:31 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:31 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241" returned: 0 in 0.274s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:39:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5059cc8f-1123-4801-8deb-99e505dbd60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f84823-b592-4d16-bf71-f72709538241', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880271c6-8d31-405c-87aa-4e89a926d78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:31 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Volume volume-d8f84823-b592-4d16-bf71-f72709538241 (d8f84823-b592-4d16-bf71-f72709538241): created successfully Sep 05 04:39:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880271c6-8d31-405c-87aa-4e89a926d78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Flow 'volume_create_manager' (51a67766-9397-4f4f-bf24-57f746969079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:31 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c0e6c88f-c88e-4510-9a47-a67e2c6443f9 tempest-VolumesTestJSON-451995854 None] Created volume successfully. Sep 05 04:39:32 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:39:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Flow 'volume_create_manager' (90f3b63d-4690-47c0-a725-cea7424e85d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2a8788-4ee2-4db4-b1be-fb4bf3a0166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2a8788-4ee2-4db4-b1be-fb4bf3a0166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-243623594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3524ae31-6c68-4fe0-83ae-bced1260030e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4cf75db332f40cca155d942dc17946b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:33Z,use_quota=True,user_id='3da055edf04e479196413178b811e9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befbefdc-0bd5-4b56-900d-ccd0eea3e369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befbefdc-0bd5-4b56-900d-ccd0eea3e369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0772b0a0-f712-433c-876f-b1f59c6a71d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0772b0a0-f712-433c-876f-b1f59c6a71d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3524ae31-6c68-4fe0-83ae-bced1260030e', 'volume_name': 'volume-3524ae31-6c68-4fe0-83ae-bced1260030e', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a56948-1a77-47ae-aa59-aa3d4af69f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a56948-1a77-47ae-aa59-aa3d4af69f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fa83d4-3833-4c4d-bb23-c66ac4e2711a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:33 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Volume 3524ae31-6c68-4fe0-83ae-bced1260030e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3524ae31-6c68-4fe0-83ae-bced1260030e', 'volume_size': 1} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-243623594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3524ae31-6c68-4fe0-83ae-bced1260030e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4cf75db332f40cca155d942dc17946b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:33Z,use_quota=True,user_id='3da055edf04e479196413178b811e9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Creating volume 3524ae31-6c68-4fe0-83ae-bced1260030e {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:39:33 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:33 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e 1073741824 Sep 05 04:39:33 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Flow 'volume_create_manager' (f10e8c44-66db-45b9-bb46-a7baeb90efe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6696cde-4eb0-4da9-b10d-9662cad81b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6696cde-4eb0-4da9-b10d-9662cad81b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2116274796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb04a3a-0901-4d44-8858-7259415a3038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497f2415941e443ab8d97f2b3ce89fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:33Z,use_quota=True,user_id='fca7be422503441bb907cd6325e23d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18212266-2dfd-4e21-8381-11b45b1e77a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18212266-2dfd-4e21-8381-11b45b1e77a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0bcde9-8ff3-42af-acbd-587068ac013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0bcde9-8ff3-42af-acbd-587068ac013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb04a3a-0901-4d44-8858-7259415a3038', 'volume_name': 'volume-cfb04a3a-0901-4d44-8858-7259415a3038', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d81726-41b2-4f80-b136-237a78551899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d81726-41b2-4f80-b136-237a78551899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e7e82c-ed6e-47b7-b690-20c08d36a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:33 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Volume cfb04a3a-0901-4d44-8858-7259415a3038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb04a3a-0901-4d44-8858-7259415a3038', 'volume_size': 1} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:33 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e 1073741824" returned: 0 in 0.537s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:33 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e Sep 05 04:39:33 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:33 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e" returned: 0 in 0.275s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2116274796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb04a3a-0901-4d44-8858-7259415a3038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497f2415941e443ab8d97f2b3ce89fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:33Z,use_quota=True,user_id='fca7be422503441bb907cd6325e23d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Creating volume cfb04a3a-0901-4d44-8858-7259415a3038 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:39:33 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fa83d4-3833-4c4d-bb23-c66ac4e2711a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3524ae31-6c68-4fe0-83ae-bced1260030e', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6555578-bd0d-47bc-9e04-96415fb2372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:34 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Volume volume-3524ae31-6c68-4fe0-83ae-bced1260030e (3524ae31-6c68-4fe0-83ae-bced1260030e): created successfully Sep 05 04:39:34 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038 1073741824 Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6555578-bd0d-47bc-9e04-96415fb2372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:34 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Flow 'volume_create_manager' (90f3b63d-4690-47c0-a725-cea7424e85d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:34 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7580ab07-0d43-4303-9749-f69e0c082668 tempest-VolumesTestJSON-451995854 None] Created volume successfully. Sep 05 04:39:34 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038 1073741824" returned: 0 in 0.536s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:34 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038 Sep 05 04:39:34 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:34 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038" returned: 0 in 0.274s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e7e82c-ed6e-47b7-b690-20c08d36a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb04a3a-0901-4d44-8858-7259415a3038', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14c9d32-79b8-4658-abc8-9a975eb284d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:34 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Volume volume-cfb04a3a-0901-4d44-8858-7259415a3038 (cfb04a3a-0901-4d44-8858-7259415a3038): created successfully Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14c9d32-79b8-4658-abc8-9a975eb284d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Flow 'volume_create_manager' (f10e8c44-66db-45b9-bb46-a7baeb90efe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:34 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-570ffefe-7c1a-4be9-8826-48b332b2f1c2 tempest-ServersNegativeTestJSON-1803127769 None] Created volume successfully. Sep 05 04:39:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Acquiring lock "cinder-cfb04a3a-0901-4d44-8858-7259415a3038-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Lock "cinder-cfb04a3a-0901-4d44-8858-7259415a3038-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Acquiring lock "cinder-quobyte-cfb04a3a-0901-4d44-8858-7259415a3038" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Lock "cinder-quobyte-cfb04a3a-0901-4d44-8858-7259415a3038" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3482f110-3828-41ba-ba9d-29ccf61ca103]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:36 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038 Sep 05 04:39:36 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:36 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038" returned: 0 in 0.435s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:36 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038 Sep 05 04:39:36 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Acquiring lock "cinder-3524ae31-6c68-4fe0-83ae-bced1260030e-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Lock "cinder-3524ae31-6c68-4fe0-83ae-bced1260030e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Acquiring lock "cinder-quobyte-3524ae31-6c68-4fe0-83ae-bced1260030e" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Lock "cinder-quobyte-3524ae31-6c68-4fe0-83ae-bced1260030e" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f90408d-8a40-4783-bb74-c1ecc0fa4814]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:36 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:36 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-cfb04a3a-0901-4d44-8858-7259415a3038" returned: 0 in 0.294s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:36 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Lock "cinder-quobyte-cfb04a3a-0901-4d44-8858-7259415a3038" released by "delete_volume" :: held 0.788s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Created reservations ['858f99e0-f725-4390-b681-c9d9cf7f8e52', '40d9c8eb-0164-45f0-b297-3fabd04f9369', 'fe5d0a47-3f9a-40c9-8b09-b8892e849f57', 'c7c601f1-e62d-48fe-b662-bcf570b9d6d1'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:37 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:39:37 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:37 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e" returned: 0 in 0.416s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:37 devstack sudo[92628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e Sep 05 04:39:37 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Acquiring lock "cinder-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Lock "cinder-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Acquiring lock "cinder-quobyte-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Lock "cinder-quobyte-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:37 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bf85a5-b310-4703-b7aa-ba919dc7cbd9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.317s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:39:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Deleted volume successfully. Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1b8e3f-b287-4b2b-a953-40ce4f466196 tempest-ServersNegativeTestJSON-1803127769 None] Lock "cinder-cfb04a3a-0901-4d44-8858-7259415a3038-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:37 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 Sep 05 04:39:37 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:37 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3524ae31-6c68-4fe0-83ae-bced1260030e" returned: 0 in 0.316s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Lock "cinder-quobyte-3524ae31-6c68-4fe0-83ae-bced1260030e" released by "delete_volume" :: held 0.778s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Created reservations ['1710bf3d-c961-4730-bf3e-85bcec101363', 'ab7b361e-8b73-4b27-8e92-f4eb98107b98', '296d1b12-0205-48c9-9be9-733e08d8e278', '3e6d8141-7786-4183-880d-13549dc0147f'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:37 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:39:37 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:37 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0" returned: 0 in 0.428s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:37 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0 Sep 05 04:39:37 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Acquiring lock "cinder-d8f84823-b592-4d16-bf71-f72709538241-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Lock "cinder-d8f84823-b592-4d16-bf71-f72709538241-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Acquiring lock "cinder-quobyte-d8f84823-b592-4d16-bf71-f72709538241" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:37 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.307s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Lock "cinder-quobyte-d8f84823-b592-4d16-bf71-f72709538241" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Deleted volume successfully. Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c6dbf-0d7b-4afa-9820-0849431ec07b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9cb881ee-ebc5-40f2-a500-53b25ce6bcd0 tempest-VolumesTestJSON-451995854 None] Lock "cinder-3524ae31-6c68-4fe0-83ae-bced1260030e-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:38 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0" returned: 0 in 0.365s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:38 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241 Sep 05 04:39:38 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Lock "cinder-quobyte-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0" released by "delete_volume" :: held 0.849s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Created reservations ['c4675aa3-a9de-45b1-a993-6f31253eb5ea', '14cdd579-caf1-461f-b54f-26ba1a19087c', 'd42b3010-7015-4822-8883-e7e6604d6748', '7ffd6338-ec1c-4e64-9ddd-f617291ea5f4'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:38 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:39:38 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:38 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241" returned: 0 in 0.481s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:38 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241 Sep 05 04:39:38 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Flow 'volume_create_manager' (487d3a94-fdb3-47d5-8446-3b7c38ca4ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920211be-f696-4459-b7dc-21dda3b07082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:38 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920211be-f696-4459-b7dc-21dda3b07082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1415376370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b179eb3-71cf-4ce1-95ac-739159921f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276e3c71009f4314a046e8921049c133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:38Z,use_quota=True,user_id='616b7bb5a2d245f38d51b517fd434633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f46d84-8ea1-4851-8b6d-9aeb72667000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f46d84-8ea1-4851-8b6d-9aeb72667000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2cddc96-f1fd-4e74-bcb9-1e24a8b2f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2cddc96-f1fd-4e74-bcb9-1e24a8b2f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b179eb3-71cf-4ce1-95ac-739159921f2a', 'volume_name': 'volume-9b179eb3-71cf-4ce1-95ac-739159921f2a', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56746c59-3227-45a2-9896-cc9873843d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56746c59-3227-45a2-9896-cc9873843d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae7c7f4-2f81-40d0-9360-50a1350cfe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:38 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Volume 9b179eb3-71cf-4ce1-95ac-739159921f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b179eb3-71cf-4ce1-95ac-739159921f2a', 'volume_size': 1} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1415376370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b179eb3-71cf-4ce1-95ac-739159921f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276e3c71009f4314a046e8921049c133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:38Z,use_quota=True,user_id='616b7bb5a2d245f38d51b517fd434633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Creating volume 9b179eb3-71cf-4ce1-95ac-739159921f2a {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:39:38 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.394s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:39:38 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Deleted volume successfully. Sep 05 04:39:38 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a 1073741824 Sep 05 04:39:38 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-190de92a-fe87-48f5-b18d-7dbeb236467c tempest-ServersNegativeTestJSON-1803127769 None] Lock "cinder-ea51c3d3-8970-4304-81c9-3ec6fc16b2c0-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:38 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d8f84823-b592-4d16-bf71-f72709538241" returned: 0 in 0.343s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Lock "cinder-quobyte-d8f84823-b592-4d16-bf71-f72709538241" released by "delete_volume" :: held 0.872s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Created reservations ['fea68c65-a89e-43df-914a-d3df661d05e1', '7fedecf7-1ab7-4e2c-8c95-2d4d4f45b9ab', '6c306334-d638-4c46-a7f5-43447c53cb8b', '24f16998-c409-4cc4-a3e8-3c867462f296'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:38 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:39:38 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Acquiring lock "cinder-b765ad77-69a4-4ce9-9afe-f684d4c3e979-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Lock "cinder-b765ad77-69a4-4ce9-9afe-f684d4c3e979-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Acquiring lock "cinder-quobyte-b765ad77-69a4-4ce9-9afe-f684d4c3e979" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Lock "cinder-quobyte-b765ad77-69a4-4ce9-9afe-f684d4c3e979" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:39 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a 1073741824" returned: 0 in 0.738s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec6168c-c159-49b3-a7f9-4dad2939b1ce]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:39 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.491s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:39:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Deleted volume successfully. Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8ad9b8d0-6134-42c0-bbfa-d75885b9f107 tempest-VolumesTestJSON-451995854 None] Lock "cinder-d8f84823-b592-4d16-bf71-f72709538241-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:39 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a Sep 05 04:39:39 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:39 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979 Sep 05 04:39:39 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:39 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a" returned: 0 in 0.329s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae7c7f4-2f81-40d0-9360-50a1350cfe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b179eb3-71cf-4ce1-95ac-739159921f2a', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24117103-2712-41d6-9ea9-efdf97c529f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:39 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Volume volume-9b179eb3-71cf-4ce1-95ac-739159921f2a (9b179eb3-71cf-4ce1-95ac-739159921f2a): created successfully Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24117103-2712-41d6-9ea9-efdf97c529f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Flow 'volume_create_manager' (487d3a94-fdb3-47d5-8446-3b7c38ca4ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-cdab2c6e-4198-4a69-a76c-770fc22da549 req-676774c4-32a3-45fb-a086-914f6d0d34e8 tempest-VolumesSnapshotsTestJSON-1670278639 None] Created volume successfully. Sep 05 04:39:39 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979" returned: 0 in 0.490s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:39 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979 Sep 05 04:39:39 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:40 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b765ad77-69a4-4ce9-9afe-f684d4c3e979" returned: 0 in 0.362s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Lock "cinder-quobyte-b765ad77-69a4-4ce9-9afe-f684d4c3e979" released by "delete_volume" :: held 0.930s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Created reservations ['50c61e25-1f2a-4552-a1d4-a430ca1f98da', '2cfbf79a-72b4-461f-8c46-1150e056859d', 'a99ea37d-7746-4d12-8d05-5d3328027eb1', '8600f144-0c06-4228-b6f3-939c97b36187'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:40 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:39:40 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:40 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.262s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:39:40 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Deleted volume successfully. Sep 05 04:39:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b975dcf8-70f5-4ee4-b4d5-c7e91c2e1d93 tempest-VolumesTestJSON-451995854 None] Lock "cinder-b765ad77-69a4-4ce9-9afe-f684d4c3e979-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Creating offline snapshot 9b52edeb-a0dc-4041-99c1-47ddb76c349f of volume 9b179eb3-71cf-4ce1-95ac-739159921f2a {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:39:41 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a21bf74-e78d-4d25-8935-55b3431d2e32]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:41 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a Sep 05 04:39:41 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:41 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a" returned: 0 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:41 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f 1G Sep 05 04:39:41 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:41 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f 1G" returned: 0 in 0.476s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b179eb3-71cf-4ce1-95ac-739159921f2a -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:41 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b179eb3-71cf-4ce1-95ac-739159921f2a -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f Sep 05 04:39:41 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:42 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b179eb3-71cf-4ce1-95ac-739159921f2a -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f" returned: 0 in 0.367s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:42 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f is being set with open permissions: ugo+rw Sep 05 04:39:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:42 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f Sep 05 04:39:42 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:42 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f" returned: 0 in 0.271s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:42 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.info Sep 05 04:39:42 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:42 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.info" returned: 0 in 0.304s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:42 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.info is being set with open permissions: ugo+rw Sep 05 04:39:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:42 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.info Sep 05 04:39:42 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:43 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.info" returned: 0 in 0.375s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.300s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:43 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-abf14cb4-339d-454a-bc83-684693530995 req-66dd7f8f-0f9b-4c4a-8850-f5e7798144f4 tempest-VolumesSnapshotsTestJSON-1670278639 None] Create snapshot completed successfully Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Acquiring lock "cinder-9b52edeb-a0dc-4041-99c1-47ddb76c349f-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "cinder-9b52edeb-a0dc-4041-99c1-47ddb76c349f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Acquiring lock "cinder-quobyte-9b179eb3-71cf-4ce1-95ac-739159921f2a" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "cinder-quobyte-9b179eb3-71cf-4ce1-95ac-739159921f2a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Acquiring lock "cinder-quobyte-9b52edeb-a0dc-4041-99c1-47ddb76c349f" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "cinder-quobyte-9b52edeb-a0dc-4041-99c1-47ddb76c349f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Deleting offline snapshot 9b52edeb-a0dc-4041-99c1-47ddb76c349f of volume 9b179eb3-71cf-4ce1-95ac-739159921f2a {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] snapshot_file for this snap is: volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3666c6-72dc-4d09-98e7-d7eadd8fdba1]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:43 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f Sep 05 04:39:43 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:44 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b179eb3-71cf-4ce1-95ac-739159921f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:39:44 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[56056615-4fbe-47fc-8909-a04da7372f10]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:44 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a Sep 05 04:39:44 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:44 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a" returned: 0 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:44 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f Sep 05 04:39:44 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:44 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f" returned: 0 in 0.351s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:44 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f Sep 05 04:39:44 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:45 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a.9b52edeb-a0dc-4041-99c1-47ddb76c349f" returned: 0 in 0.248s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "cinder-quobyte-9b52edeb-a0dc-4041-99c1-47ddb76c349f" released by "_delete_snapshot" :: held 1.498s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "cinder-quobyte-9b179eb3-71cf-4ce1-95ac-739159921f2a" released by "delete_snapshot" :: held 1.520s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:45 devstack cinder-volume[89807]: WARNING cinder.quota [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG cinder.quota [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Created reservations ['6ee2a308-5862-4191-bf7e-bede66d8db4f', 'd527294f-22e3-4871-a9a2-cd466323d5f4', '9615585e-4c0b-4edd-9c49-da01443ad252', '3052f6d5-1947-4d21-8d86-d9405cfbfdf2'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:39:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Delete snapshot completed successfully. Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-477e9d94-82aa-4fda-8cfd-dfad6c3fa963 req-8724c3b4-64fd-4c1c-a344-7323b06d93e1 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "cinder-9b52edeb-a0dc-4041-99c1-47ddb76c349f-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Acquiring lock "cinder-9b179eb3-71cf-4ce1-95ac-739159921f2a-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "cinder-9b179eb3-71cf-4ce1-95ac-739159921f2a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Acquiring lock "cinder-quobyte-9b179eb3-71cf-4ce1-95ac-739159921f2a" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "cinder-quobyte-9b179eb3-71cf-4ce1-95ac-739159921f2a" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f901b76-09dc-4d8e-92c4-de892aa9ed67]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:46 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a Sep 05 04:39:46 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:46 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a" returned: 0 in 0.492s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:46 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a Sep 05 04:39:46 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:46 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9b179eb3-71cf-4ce1-95ac-739159921f2a" returned: 0 in 0.278s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "cinder-quobyte-9b179eb3-71cf-4ce1-95ac-739159921f2a" released by "delete_volume" :: held 0.852s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG cinder.quota [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Created reservations ['740adfd8-818a-45db-ae68-4bd332a066d4', '2d6bd435-f79c-4fa8-9c97-d28837bd4ffb', '976450f8-e44f-45ea-b25d-91c3bda04a05', '12b11190-c9cf-48e5-b8a1-2dd1ba6fe3b6'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:46 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:39:46 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:47 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:47 devstack cinder-volume[89807]: DEBUG cinder.manager [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:39:47 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Deleted volume successfully. Sep 05 04:39:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-92800b32-2a78-4b02-8842-3da259ea0d92 req-e4843ef7-a0c6-4126-8cd2-1a1d3b893d19 tempest-VolumesSnapshotsTestJSON-1670278639 None] Lock "cinder-9b179eb3-71cf-4ce1-95ac-739159921f2a-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Flow 'volume_create_manager' (a424fff9-fa13-4b01-ab4d-5deab707bfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab94e93-5902-4ac6-8a53-605bddb46229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab94e93-5902-4ac6-8a53-605bddb46229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1204325384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a36cc68-a7df-4774-853f-f1b7cb0e3103,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='516b926c819649b2b9c9fe94cb7bea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:51Z,use_quota=True,user_id='8db4dbb331684277bccfd8b8b2fe9124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ef7bcd-1640-449c-a800-5c720c4d2abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ef7bcd-1640-449c-a800-5c720c4d2abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c5117e-3fd6-47d3-8488-ac7f0d08bc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c5117e-3fd6-47d3-8488-ac7f0d08bc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a36cc68-a7df-4774-853f-f1b7cb0e3103', 'volume_name': 'volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff53e4d4-895b-4e27-9926-87fb03e2f555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff53e4d4-895b-4e27-9926-87fb03e2f555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088d8126-56c6-46e8-9536-1e0dcd584195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:50 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Volume 8a36cc68-a7df-4774-853f-f1b7cb0e3103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103', 'volume_size': 1} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1204325384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a36cc68-a7df-4774-853f-f1b7cb0e3103,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='516b926c819649b2b9c9fe94cb7bea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:51Z,use_quota=True,user_id='8db4dbb331684277bccfd8b8b2fe9124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Creating volume 8a36cc68-a7df-4774-853f-f1b7cb0e3103 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:39:50 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:39:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:50 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103 1073741824 Sep 05 04:39:50 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:51 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103 1073741824" returned: 0 in 0.530s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:51 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=91,cinder:SELECT=70,cinder:DELETE=10,cinder:INSERT=20 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:39:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:51 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103 Sep 05 04:39:51 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:51 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103" returned: 0 in 0.392s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:39:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088d8126-56c6-46e8-9536-1e0dcd584195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afa8f41-1ddb-4588-bb4e-fa85ccc4b916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:51 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Volume volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103 (8a36cc68-a7df-4774-853f-f1b7cb0e3103): created successfully Sep 05 04:39:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afa8f41-1ddb-4588-bb4e-fa85ccc4b916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Flow 'volume_create_manager' (a424fff9-fa13-4b01-ab4d-5deab707bfa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-4785741f-b0db-4828-b6ce-a65bb44ab64d req-7f541bf0-59e9-4b8b-bdd1-815b523f6f07 tempest-VolumesGetTestJSON-1539574704 None] Created volume successfully. Sep 05 04:39:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-21723d94-196e-4ba9-ae5b-753bddd556e3 tempest-GroupSnapshotsV319Test-652611317 None] Group tempest-GroupSnapshotsV319Test-Group-2030021441: creating Sep 05 04:39:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-21723d94-196e-4ba9-ae5b-753bddd556e3 tempest-GroupSnapshotsV319Test-652611317 None] Group tempest-GroupSnapshotsV319Test-Group-2030021441: created successfully Sep 05 04:39:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-21723d94-196e-4ba9-ae5b-753bddd556e3 tempest-GroupSnapshotsV319Test-652611317 None] Create group completed successfully. Sep 05 04:39:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Acquiring lock "cinder-8a36cc68-a7df-4774-853f-f1b7cb0e3103-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Lock "cinder-8a36cc68-a7df-4774-853f-f1b7cb0e3103-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Acquiring lock "cinder-quobyte-8a36cc68-a7df-4774-853f-f1b7cb0e3103" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:39:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Lock "cinder-quobyte-8a36cc68-a7df-4774-853f-f1b7cb0e3103" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:39:53 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[113b7889-33d5-4f4b-a1ed-91616aada07a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:53 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103 Sep 05 04:39:53 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-2aaad9f3-2a3f-4e6e-9032-87c7b6afe717 req-740ac374-b672-431b-9abc-8cf01dba0130 tempest-TaggedAttachmentsTest-1601119526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-2aaad9f3-2a3f-4e6e-9032-87c7b6afe717 req-740ac374-b672-431b-9abc-8cf01dba0130 tempest-TaggedAttachmentsTest-1601119526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-2aaad9f3-2a3f-4e6e-9032-87c7b6afe717 req-740ac374-b672-431b-9abc-8cf01dba0130 tempest-TaggedAttachmentsTest-1601119526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-2aaad9f3-2a3f-4e6e-9032-87c7b6afe717 req-740ac374-b672-431b-9abc-8cf01dba0130 tempest-TaggedAttachmentsTest-1601119526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-8bd37196-1192-46d6-92c0-9b9196da4fb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0b62190-0516-43bc-ad0c-8b831a440761', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:39:54 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-2aaad9f3-2a3f-4e6e-9032-87c7b6afe717 req-740ac374-b672-431b-9abc-8cf01dba0130 tempest-TaggedAttachmentsTest-1601119526 None] attachment_update completed successfully. Sep 05 04:39:54 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103" returned: 0 in 0.445s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:54 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103 Sep 05 04:39:54 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Flow 'volume_create_manager' (3101c5ef-b263-4576-aced-0fa9017862af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797c36d9-904c-4a72-a5a7-ee35fe9efa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797c36d9-904c-4a72-a5a7-ee35fe9efa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2051848102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4399394-625b-4f86-aeef-dc58d9b00ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67bb0d7c01d44e9a01a9787aea1d814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:54Z,use_quota=True,user_id='e2d95341297a40a093694850df1f86e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2805531a-6171-42cf-8fed-ac5071a0a6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2805531a-6171-42cf-8fed-ac5071a0a6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ec3e7b-89aa-49e4-b5b0-b8faf349c737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ec3e7b-89aa-49e4-b5b0-b8faf349c737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4399394-625b-4f86-aeef-dc58d9b00ff2', 'volume_name': 'volume-c4399394-625b-4f86-aeef-dc58d9b00ff2', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5806f1-9301-4eca-ae4a-75d23bf26a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5806f1-9301-4eca-ae4a-75d23bf26a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807a9e68-4be1-4123-a595-32a72782cfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:54 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Volume c4399394-625b-4f86-aeef-dc58d9b00ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4399394-625b-4f86-aeef-dc58d9b00ff2', 'volume_size': 1} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2051848102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4399394-625b-4f86-aeef-dc58d9b00ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67bb0d7c01d44e9a01a9787aea1d814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:54Z,use_quota=True,user_id='e2d95341297a40a093694850df1f86e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Creating volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:39:54 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:54 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 1073741824 Sep 05 04:39:54 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:54 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a36cc68-a7df-4774-853f-f1b7cb0e3103" returned: 0 in 0.328s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Lock "cinder-quobyte-8a36cc68-a7df-4774-853f-f1b7cb0e3103" released by "delete_volume" :: held 0.814s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.quota [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Created reservations ['d6e988b6-d814-4621-a34d-a7309c40d80f', '0ed0aac0-852d-4590-b8f3-bc20903339ce', '0f6e96c7-8e0b-42d7-b09f-9310b89633ab', 'c2ec3cbd-2aca-4dc5-8460-6ecef94f37ef'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:54 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:39:54 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:55 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.331s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.manager [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:39:55 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Deleted volume successfully. Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-f21f6e65-0b9d-4ceb-8752-90f6ac08c410 req-047b3a72-e28c-4f98-b572-708c84899480 tempest-VolumesGetTestJSON-1539574704 None] Lock "cinder-8a36cc68-a7df-4774-853f-f1b7cb0e3103-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:39:55 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 1073741824" returned: 0 in 0.780s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Flow 'volume_create_manager' (d77279f2-d2c9-4afe-a121-73fd7c7c25d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a65dae4-4adb-45d4-851e-5d9f1247e13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a65dae4-4adb-45d4-851e-5d9f1247e13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-788914279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07076dcc-4c4f-4ea8-9851-792eb76020cb,host='devstack@QuobyteHD#QuobyteHD',id=397ad333-df5e-407c-8a63-a8131dbb7993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9318b35af3e54566842cd9bbdf7c48d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:55Z,use_quota=True,user_id='7dce5c8021264ce3b1c4d94b24104d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2918f034-1afe-4556-8cb5-35266ffeaf69),volume_type_id=2918f034-1afe-4556-8cb5-35266ffeaf69)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:55 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 Sep 05 04:39:55 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d44974c-63ae-4c41-a249-00d3da757a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d44974c-63ae-4c41-a249-00d3da757a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bf727b-d1ec-40e2-98d1-935a923e1fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bf727b-d1ec-40e2-98d1-935a923e1fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '397ad333-df5e-407c-8a63-a8131dbb7993', 'volume_name': 'volume-397ad333-df5e-407c-8a63-a8131dbb7993', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84ef59d-49fe-4e22-8106-b29f61ce73ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84ef59d-49fe-4e22-8106-b29f61ce73ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2208ef55-846b-4f1f-b4f8-4a5515458218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:55 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Volume 397ad333-df5e-407c-8a63-a8131dbb7993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-397ad333-df5e-407c-8a63-a8131dbb7993', 'volume_size': 1} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:55 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2" returned: 0 in 0.255s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.199s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=07076dcc-4c4f-4ea8-9851-792eb76020cb,created_at=2026-09-05T02:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-788914279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07076dcc-4c4f-4ea8-9851-792eb76020cb,host='devstack@QuobyteHD#QuobyteHD',id=397ad333-df5e-407c-8a63-a8131dbb7993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9318b35af3e54566842cd9bbdf7c48d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:39:55Z,use_quota=True,user_id='7dce5c8021264ce3b1c4d94b24104d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2918f034-1afe-4556-8cb5-35266ffeaf69),volume_type_id=2918f034-1afe-4556-8cb5-35266ffeaf69)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Creating volume 397ad333-df5e-407c-8a63-a8131dbb7993 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:39:55 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:55 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 1073741824 Sep 05 04:39:55 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807a9e68-4be1-4123-a595-32a72782cfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4399394-625b-4f86-aeef-dc58d9b00ff2', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870166c5-867e-44a4-9f1c-5b8a683a25cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:55 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Volume volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 (c4399394-625b-4f86-aeef-dc58d9b00ff2): created successfully Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870166c5-867e-44a4-9f1c-5b8a683a25cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Flow 'volume_create_manager' (3101c5ef-b263-4576-aced-0fa9017862af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:55 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-406659c1-1ab2-4d1d-ade2-bc39545b02fa tempest-SnapshotsActionsTest-1124761940 None] Created volume successfully. Sep 05 04:39:56 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 1073741824" returned: 0 in 0.482s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:56 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 Sep 05 04:39:56 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:56 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993" returned: 0 in 0.317s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2208ef55-846b-4f1f-b4f8-4a5515458218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-397ad333-df5e-407c-8a63-a8131dbb7993', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52a7870-7bb9-4394-91a4-4ea888e456d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:39:56 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Volume volume-397ad333-df5e-407c-8a63-a8131dbb7993 (397ad333-df5e-407c-8a63-a8131dbb7993): created successfully Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52a7870-7bb9-4394-91a4-4ea888e456d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Flow 'volume_create_manager' (d77279f2-d2c9-4afe-a121-73fd7c7c25d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:39:56 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-bcec0b85-362a-423e-86e6-8f08198b2a68 tempest-GroupSnapshotsV319Test-652611317 None] Created volume successfully. Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Creating offline snapshot aacc81c4-128a-4991-bc0f-4b75f10efa26 of volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f58bf5-f5f0-47a4-b74c-5f8d243922ed]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:57 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 Sep 05 04:39:57 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:57 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2" returned: 0 in 0.464s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-d8eecdfd-c41c-4894-97fb-21ff9564b25d req-7f19faed-e7e5-40ed-8189-2e63ca7a4355 tempest-TaggedAttachmentsTest-1601119526 None] Terminate volume connection completed successfully. Sep 05 04:39:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-d8eecdfd-c41c-4894-97fb-21ff9564b25d req-7f19faed-e7e5-40ed-8189-2e63ca7a4355 tempest-TaggedAttachmentsTest-1601119526 None] Deleting attachment f0b62190-0516-43bc-ad0c-8b831a440761. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:39:57 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 1G Sep 05 04:39:57 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:57 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 1G" returned: 0 in 0.431s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:57 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:39:57 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:58 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] GroupSnapshot 352f9c2b-141b-4ed7-96f5-0257c1a9eb54: creating. Sep 05 04:39:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Group snapshot 352f9c2b-141b-4ed7-96f5-0257c1a9eb54: creating. {{(pid=89807) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 04:39:58 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.406s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:58 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 is being set with open permissions: ugo+rw Sep 05 04:39:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:39:58 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:39:58 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:58 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.302s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:58 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.info Sep 05 04:39:58 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:58 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.info" returned: 0 in 0.452s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:58 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.info is being set with open permissions: ugo+rw Sep 05 04:39:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:59 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.info Sep 05 04:39:59 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:59 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.info" returned: 0 in 0.327s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:39:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.146s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:39:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Creating offline snapshot fda82679-eace-48d1-b6cc-9b1d037159cf of volume 397ad333-df5e-407c-8a63-a8131dbb7993 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:39:59 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9bbc528a-6a65-4291-9a92-26691ce21973 tempest-SnapshotsActionsTest-1124761940 None] Create snapshot completed successfully Sep 05 04:39:59 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20cd396-b1cf-4092-8362-1d2bd1d82231]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:39:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:59 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 Sep 05 04:39:59 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:39:59 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Sep 05 04:39:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993" returned: 0 in 0.429s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:39:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:39:59 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf 1G Sep 05 04:39:59 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:00 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf 1G" returned: 0 in 0.571s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-397ad333-df5e-407c-8a63-a8131dbb7993 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:00 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-397ad333-df5e-407c-8a63-a8131dbb7993 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf Sep 05 04:40:00 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:00 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-397ad333-df5e-407c-8a63-a8131dbb7993 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf" returned: 0 in 0.407s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:00 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:40:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:00 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf Sep 05 04:40:00 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:00 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-444ae8e8-7910-44ed-978b-01e7797abd93 tempest-GroupSnapshotsTest-941596947 None] Group tempest-GroupSnapshotsTest-Group-1106548957: creating Sep 05 04:40:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:01 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-444ae8e8-7910-44ed-978b-01e7797abd93 tempest-GroupSnapshotsTest-941596947 None] Group tempest-GroupSnapshotsTest-Group-1106548957: created successfully Sep 05 04:40:01 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-444ae8e8-7910-44ed-978b-01e7797abd93 tempest-GroupSnapshotsTest-941596947 None] Create group completed successfully. Sep 05 04:40:01 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf" returned: 0 in 0.260s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:01 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.info Sep 05 04:40:01 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:01 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.info" returned: 0 in 0.278s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:01 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:40:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:01 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.info Sep 05 04:40:01 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:01 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.info" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.681s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] Creating offline snapshot bf86b6c4-8f1d-4cc6-8157-86e3618adec4 of volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:40:01 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29b3e70-587d-4509-af6a-eea90c35adff]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:01 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-71f85014-0e69-47a2-a6d7-414ec89c776f tempest-GroupSnapshotsV319Test-652611317 None] group_snapshot 352f9c2b-141b-4ed7-96f5-0257c1a9eb54: created successfully Sep 05 04:40:01 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:01 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:02 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.429s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:02 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 1G Sep 05 04:40:02 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Flow 'volume_create_manager' (f16bd6e5-2e11-4940-9f66-16a7f0ecbe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb10222-85dc-466b-abcf-dcabb153b214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb10222-85dc-466b-abcf-dcabb153b214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-703775721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6435a849-edc1-4f29-b046-aa6062098431,host='devstack@QuobyteHD#QuobyteHD',id=08fe61b2-2e3c-4600-b810-91fe5f5116c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c116ad98bb842cfa19b45fe890c7f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:40:03Z,use_quota=True,user_id='d522a1ead1c247e1af2c065214149f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ac1aa0b-c24f-4c34-8c49-004cf7c411ee),volume_type_id=4ac1aa0b-c24f-4c34-8c49-004cf7c411ee)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa259cd-f4a9-4f43-9181-fc785b0fd75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa259cd-f4a9-4f43-9181-fc785b0fd75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c97d88-2479-45b3-93cf-a45d9b293370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c97d88-2479-45b3-93cf-a45d9b293370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fe61b2-2e3c-4600-b810-91fe5f5116c2', 'volume_name': 'volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1007ba53-c421-48e6-9bf3-1dee6bfc137c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1007ba53-c421-48e6-9bf3-1dee6bfc137c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:02 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305665cf-9e59-4e85-b736-de24c1f8a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:02 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Volume 08fe61b2-2e3c-4600-b810-91fe5f5116c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2', 'volume_size': 1} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 1G" returned: 0 in 0.827s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:03 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 Sep 05 04:40:03 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:03 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4" returned: 0 in 0.332s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:03 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 is being set with open permissions: ugo+rw Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:03 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] group_snapshot 352f9c2b-141b-4ed7-96f5-0257c1a9eb54: deleting Sep 05 04:40:03 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 Sep 05 04:40:03 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] group_snapshot 352f9c2b-141b-4ed7-96f5-0257c1a9eb54: deleting {{(pid=89807) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Acquiring lock "cinder-quobyte-397ad333-df5e-407c-8a63-a8131dbb7993" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Lock "cinder-quobyte-397ad333-df5e-407c-8a63-a8131dbb7993" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Acquiring lock "cinder-quobyte-fda82679-eace-48d1-b6cc-9b1d037159cf" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Lock "cinder-quobyte-fda82679-eace-48d1-b6cc-9b1d037159cf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Deleting offline snapshot fda82679-eace-48d1-b6cc-9b1d037159cf of volume 397ad333-df5e-407c-8a63-a8131dbb7993 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] snapshot_file for this snap is: volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d93e24e-af14-4e86-88a6-6184848229ab]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:03 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf Sep 05 04:40:03 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:03 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4" returned: 0 in 0.341s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6435a849-edc1-4f29-b046-aa6062098431,created_at=2026-09-05T02:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-703775721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6435a849-edc1-4f29-b046-aa6062098431,host='devstack@QuobyteHD#QuobyteHD',id=08fe61b2-2e3c-4600-b810-91fe5f5116c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c116ad98bb842cfa19b45fe890c7f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:40:03Z,use_quota=True,user_id='d522a1ead1c247e1af2c065214149f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ac1aa0b-c24f-4c34-8c49-004cf7c411ee),volume_type_id=4ac1aa0b-c24f-4c34-8c49-004cf7c411ee)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Creating volume 08fe61b2-2e3c-4600-b810-91fe5f5116c2 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:40:03 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:03 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 1073741824 Sep 05 04:40:03 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:03 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-018d942e-3ec2-4d41-b6eb-7937a76b78a8 tempest-SnapshotsActionsTest-1124761940 None] Create snapshot completed successfully Sep 05 04:40:03 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf" returned: 0 in 0.494s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-397ad333-df5e-407c-8a63-a8131dbb7993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fcb084-30ce-4098-ad86-5f1e27b456dc]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:04 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 Sep 05 04:40:04 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:04 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 1073741824" returned: 0 in 0.686s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:04 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993" returned: 0 in 0.481s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:04 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 Sep 05 04:40:04 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:04 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf Sep 05 04:40:04 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-bf86b6c4-8f1d-4cc6-8157-86e3618adec4-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-bf86b6c4-8f1d-4cc6-8157-86e3618adec4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-quobyte-bf86b6c4-8f1d-4cc6-8157-86e3618adec4" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-bf86b6c4-8f1d-4cc6-8157-86e3618adec4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Deleting offline snapshot bf86b6c4-8f1d-4cc6-8157-86e3618adec4 of volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] snapshot_file for this snap is: volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffb29a2-e8b8-42db-b471-561b02683e54]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:04 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:04 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 Sep 05 04:40:04 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2" returned: 0 in 0.337s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305665cf-9e59-4e85-b736-de24c1f8a21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4091cbe3-0198-4f36-a461-4984bf2e57d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:04 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Volume volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 (08fe61b2-2e3c-4600-b810-91fe5f5116c2): created successfully Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4091cbe3-0198-4f36-a461-4984bf2e57d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Flow 'volume_create_manager' (f16bd6e5-2e11-4940-9f66-16a7f0ecbe74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:40:04 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e3149afd-c449-472d-b9ea-051ec7b99d6b tempest-GroupSnapshotsTest-941596947 None] Created volume successfully. Sep 05 04:40:04 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf" returned: 0 in 0.432s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:04 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf Sep 05 04:40:04 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:05 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4" returned: 0 in 0.421s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f78bf4-43b4-47b1-9a25-65c3506c2350]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:05 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993.fda82679-eace-48d1-b6cc-9b1d037159cf" returned: 0 in 0.259s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:05 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:05 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Lock "cinder-quobyte-fda82679-eace-48d1-b6cc-9b1d037159cf" released by "_delete_snapshot" :: held 1.798s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Lock "cinder-quobyte-397ad333-df5e-407c-8a63-a8131dbb7993" released by "delete_snapshot" :: held 1.822s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:05 devstack cinder-volume[89807]: WARNING cinder.quota [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-641570778 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-641570778, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:05 devstack cinder-volume[89807]: WARNING cinder.quota [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-641570778 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-641570778, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] Created reservations ['67c3839b-22bd-4092-a993-4c93e4e6a04c', '5900435c-b80b-4064-8390-0a3525fb9bbf', 'd5ca630d-6564-402b-a104-65285e797dbb', 'e66c0b27-43fa-4be5-8025-8de578efd71c'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f95573e4-9509-4460-9f4a-f59c67301bff tempest-GroupSnapshotsV319Test-652611317 None] group_snapshot 352f9c2b-141b-4ed7-96f5-0257c1a9eb54: deleted successfully Sep 05 04:40:05 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.385s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:05 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 Sep 05 04:40:05 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] GroupSnapshot 195119a8-d0b0-46c4-abc6-0b22d2f52b0c: creating. Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Group snapshot 195119a8-d0b0-46c4-abc6-0b22d2f52b0c: creating. {{(pid=89807) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Creating offline snapshot fbe3f402-b067-4fd2-9a5a-f94da348b140 of volume 08fe61b2-2e3c-4600-b810-91fe5f5116c2 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30a40fe-b3ca-43df-b236-7e5ed2aa5d37]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:05 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4" returned: 0 in 0.477s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:06 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4 Sep 05 04:40:06 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:06 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 Sep 05 04:40:06 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Acquiring lock "cinder-quobyte-397ad333-df5e-407c-8a63-a8131dbb7993" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Lock "cinder-quobyte-397ad333-df5e-407c-8a63-a8131dbb7993" acquired by "delete_volume" :: waited 0.039s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[035038e4-d916-4686-908e-d51cf263c68c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:06 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.bf86b6c4-8f1d-4cc6-8157-86e3618adec4" returned: 0 in 0.325s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-bf86b6c4-8f1d-4cc6-8157-86e3618adec4" released by "_delete_snapshot" :: held 1.718s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" released by "delete_snapshot" :: held 1.763s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:06 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2" returned: 0 in 0.461s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:06 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 Sep 05 04:40:06 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:06 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 1G Sep 05 04:40:06 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Created reservations ['d1f6e01c-70f2-44eb-b970-7c2c55916368', 'b76524cc-8fdb-4a15-8d1d-7836ce780b1e', '6de960da-a3cb-4589-9a30-47f7b7a07c90', 'f606d229-9b49-4027-8745-30483ae2a415'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Delete snapshot completed successfully. Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e82272f-ec18-4fbf-ab77-b9e95891a0d0 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-bf86b6c4-8f1d-4cc6-8157-86e3618adec4-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:06 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993" returned: 0 in 0.437s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:06 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993 Sep 05 04:40:06 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:06 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 1G" returned: 0 in 0.478s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:06 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 Sep 05 04:40:06 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:07 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-397ad333-df5e-407c-8a63-a8131dbb7993" returned: 0 in 0.342s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Lock "cinder-quobyte-397ad333-df5e-407c-8a63-a8131dbb7993" released by "delete_volume" :: held 0.859s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Created reservations ['1f78b8b0-1e92-4276-b4ec-822082965542'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:07 devstack cinder-volume[89807]: WARNING cinder.quota [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-641570778 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-641570778, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Created reservations ['c2c464d6-15e2-44c7-8b69-adee4ebe6c0b', '118f2991-1dfd-4de3-98a1-213f09d77d50', 'b6e52362-bd82-408d-98b0-cd889fbf96d7', '6e17c9fb-0daa-44f0-9c86-ea74b1e1e860'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:07 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140" returned: 0 in 0.438s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:07 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:07 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 Sep 05 04:40:07 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:07 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:40:07 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:07 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140" returned: 0 in 0.368s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:07 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.391s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:40:07 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-59026d91-451c-4bbf-9e72-b04b1d05c1bf tempest-GroupSnapshotsV319Test-652611317 None] Delete group completed successfully. Sep 05 04:40:07 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.info Sep 05 04:40:07 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Acquiring lock "cinder-8bd37196-1192-46d6-92c0-9b9196da4fb5-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Lock "cinder-8bd37196-1192-46d6-92c0-9b9196da4fb5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Acquiring lock "cinder-quobyte-8bd37196-1192-46d6-92c0-9b9196da4fb5" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Lock "cinder-quobyte-8bd37196-1192-46d6-92c0-9b9196da4fb5" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9336a14-9371-462b-b6fb-5c6c61f390ef]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:08 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.info" returned: 0 in 0.320s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:08 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:08 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5 Sep 05 04:40:08 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:08 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.info Sep 05 04:40:08 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:08 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.info" returned: 0 in 0.262s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.215s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:08 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5" returned: 0 in 0.421s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] Creating offline snapshot 9385e7ec-5367-42c1-bec6-468716dce073 of volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:40:08 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5 Sep 05 04:40:08 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec25412d-385c-4370-a2a7-9fcfdfbb88a3]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:08 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-04c3d810-92fe-4337-9e34-25f6744a8c58 tempest-GroupSnapshotsTest-941596947 None] group_snapshot 195119a8-d0b0-46c4-abc6-0b22d2f52b0c: created successfully Sep 05 04:40:08 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:08 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:08 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bd37196-1192-46d6-92c0-9b9196da4fb5" returned: 0 in 0.286s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Lock "cinder-quobyte-8bd37196-1192-46d6-92c0-9b9196da4fb5" released by "delete_volume" :: held 0.757s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Created reservations ['c899f190-1e46-4602-a144-9ffefacb46be', 'fde0d09c-27e8-4bb5-af98-183c81da2ebb', 'aceea67f-deb6-40f6-8c1f-f07f77a4f337', '42375eeb-b839-4453-8e14-d3bdfc3c2d89'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:08 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:40:08 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:08 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.416s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:08 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 1G Sep 05 04:40:08 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:09 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.364s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:09 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:40:09 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Deleted volume successfully. Sep 05 04:40:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a31562bb-d1ea-4ce0-bd21-21f11f685ae0 tempest-TaggedAttachmentsTest-1601119526 None] Lock "cinder-8bd37196-1192-46d6-92c0-9b9196da4fb5-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:09 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 1G" returned: 0 in 0.617s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:09 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 Sep 05 04:40:09 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:09 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073" returned: 0 in 0.397s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:09 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 is being set with open permissions: ugo+rw Sep 05 04:40:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:09 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 Sep 05 04:40:09 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:10 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073" returned: 0 in 0.442s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.280s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-fbe3f402-b067-4fd2-9a5a-f94da348b140-29ff9451-11f6-4414-b77b-5f6e0eea17d6" by "_create_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-fbe3f402-b067-4fd2-9a5a-f94da348b140-29ff9451-11f6-4414-b77b-5f6e0eea17d6" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Creating volume 29ff9451-11f6-4414-b77b-5f6e0eea17d6 from snapshot fbe3f402-b067-4fd2-9a5a-f94da348b140 {{(pid=89807) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-29ff9451-11f6-4414-b77b-5f6e0eea17d6" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:10 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-86e6cb57-3c6c-41a8-9721-a2c35da41009 tempest-SnapshotsActionsTest-1124761940 None] Create snapshot completed successfully Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-29ff9451-11f6-4414-b77b-5f6e0eea17d6" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] snapshot: fbe3f402-b067-4fd2-9a5a-f94da348b140, volume: 29ff9451-11f6-4414-b77b-5f6e0eea17d6, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a67276f-b635-48ed-abd8-cb98ea5141ee]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:10 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 Sep 05 04:40:10 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:10 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:40:10 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:10 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140" returned: 0 in 0.473s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:10 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.352s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dad087-e8ff-4e98-96fb-e170535c129e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 8 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:40:11 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 Sep 05 04:40:11 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-9385e7ec-5367-42c1-bec6-468716dce073-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:11 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-9385e7ec-5367-42c1-bec6-468716dce073-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2" returned: 0 in 0.503s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" acquired by "delete_snapshot" :: waited 0.043s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-quobyte-9385e7ec-5367-42c1-bec6-468716dce073" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:11 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 Sep 05 04:40:11 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-9385e7ec-5367-42c1-bec6-468716dce073" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Deleting offline snapshot 9385e7ec-5367-42c1-bec6-468716dce073 of volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] snapshot_file for this snap is: volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[816773fc-852f-4fe1-b311-979cd15138fb]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:11 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 Sep 05 04:40:11 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:12 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073" returned: 0 in 0.455s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:12 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adb2f7a-a0eb-43f5-855d-ecfb9d66fb13]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:12 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:12 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:13 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 1.011s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:13 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 Sep 05 04:40:13 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:14 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073" returned: 0 in 0.950s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:14 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073 Sep 05 04:40:14 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:14 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.9385e7ec-5367-42c1-bec6-468716dce073" returned: 0 in 0.697s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-9385e7ec-5367-42c1-bec6-468716dce073" released by "_delete_snapshot" :: held 3.348s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" released by "delete_snapshot" :: held 3.392s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:15 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Created reservations ['bd6d0289-3f82-47fb-a393-2d0463460265', 'e98d57e9-53c1-4cd9-b29b-f785b8d28ef3', '322529e2-3d79-4632-b1c4-1a34ac84a8e4', '8b3ab65b-8487-4133-9696-d552a7225568'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:15 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Delete snapshot completed successfully. Sep 05 04:40:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33b51691-a729-48b2-b013-96d00aa67d5b tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-9385e7ec-5367-42c1-bec6-468716dce073-delete_snapshot" released by "delete_snapshot" :: held 3.976s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:17 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6" returned: 0 in 6.415s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:17 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:40:17 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Converted 1024.00 MB image at 159.59 MB/s Sep 05 04:40:17 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:40:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:17 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 Sep 05 04:40:17 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:18 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6" returned: 0 in 0.305s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-29ff9451-11f6-4414-b77b-5f6e0eea17d6" released by "_copy_volume_from_snapshot" :: held 7.821s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-fbe3f402-b067-4fd2-9a5a-f94da348b140-29ff9451-11f6-4414-b77b-5f6e0eea17d6" released by "_create_volume_from_snapshot" :: held 7.915s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.951s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.355s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] Creating offline snapshot dcb3b382-588d-4776-836a-b8e307345853 of volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[89264927-0a28-4fde-a03c-31450eba9f4a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:18 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-dc676fd4-9615-4295-886c-1ed57a62b19f tempest-GroupSnapshotsTest-941596947 None] Create group from source-snapshot-195119a8-d0b0-46c4-abc6-0b22d2f52b0c completed successfully. Sep 05 04:40:18 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:18 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:18 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.426s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:18 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 1G Sep 05 04:40:18 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:19 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 1G" returned: 0 in 0.498s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:19 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 Sep 05 04:40:19 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:19 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853" returned: 0 in 0.316s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:19 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 is being set with open permissions: ugo+rw Sep 05 04:40:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:19 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 Sep 05 04:40:19 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:19 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853" returned: 0 in 0.240s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.662s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:20 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4d4bc5a3-22a8-4bcc-98f9-a336a1ec4d98 tempest-SnapshotsActionsTest-1124761940 None] Create snapshot completed successfully Sep 05 04:40:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-29ff9451-11f6-4414-b77b-5f6e0eea17d6" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-29ff9451-11f6-4414-b77b-5f6e0eea17d6" acquired by "delete_volume" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:20 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae195f71-b3bc-461e-9c3c-effe524fb339]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:20 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 Sep 05 04:40:20 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:20 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6" returned: 0 in 0.403s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:20 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6 Sep 05 04:40:20 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:20 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-29ff9451-11f6-4414-b77b-5f6e0eea17d6" returned: 0 in 0.317s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-29ff9451-11f6-4414-b77b-5f6e0eea17d6" released by "delete_volume" :: held 0.781s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Created reservations ['bd4dab4d-733e-4651-83b8-30e761557d45'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:21 devstack cinder-volume[89807]: WARNING cinder.quota [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1743393164 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1743393164, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:21 devstack cinder-volume[89807]: WARNING cinder.quota [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1743393164 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1743393164, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Created reservations ['84be2098-8812-48a2-86e3-f6ced0fe08c7', '8409b71f-3ff5-4b72-b37e-675688dba748', '98a0b044-f7d2-4ec3-95d9-baee38c9f512', '73cd7920-9c7b-4851-80cd-e27c471798ff'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-dcb3b382-588d-4776-836a-b8e307345853-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:21 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:40:21 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-dcb3b382-588d-4776-836a-b8e307345853-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-quobyte-dcb3b382-588d-4776-836a-b8e307345853" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-dcb3b382-588d-4776-836a-b8e307345853" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Deleting offline snapshot dcb3b382-588d-4776-836a-b8e307345853 of volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] snapshot_file for this snap is: volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea7375f-420a-45be-9bfe-af8bdec2c29e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:21 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] group_snapshot 195119a8-d0b0-46c4-abc6-0b22d2f52b0c: deleting Sep 05 04:40:21 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.287s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] group_snapshot 195119a8-d0b0-46c4-abc6-0b22d2f52b0c: deleting {{(pid=89807) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 04:40:21 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-cebedc74-54f3-420c-9b44-5b9d30fc49de tempest-GroupSnapshotsTest-941596947 None] Delete group completed successfully. Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-08fe61b2-2e3c-4600-b810-91fe5f5116c2" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-08fe61b2-2e3c-4600-b810-91fe5f5116c2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-fbe3f402-b067-4fd2-9a5a-f94da348b140" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:21 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 Sep 05 04:40:21 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-fbe3f402-b067-4fd2-9a5a-f94da348b140" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Deleting offline snapshot fbe3f402-b067-4fd2-9a5a-f94da348b140 of volume 08fe61b2-2e3c-4600-b810-91fe5f5116c2 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] snapshot_file for this snap is: volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e58ac8-1d93-4edf-9e29-05d926f13a6c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:21 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 Sep 05 04:40:21 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:22 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853" returned: 0 in 0.495s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5626dd28-13c6-4cf4-9d0e-b84a3c0d8bef]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:22 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:22 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:22 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140" returned: 0 in 0.503s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff4ada7-1013-474c-9aed-694c0b9bc12b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:22 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 Sep 05 04:40:22 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:22 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.531s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:22 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 Sep 05 04:40:22 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:22 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2" returned: 0 in 0.660s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:23 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 Sep 05 04:40:23 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:23 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853" returned: 0 in 0.524s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:23 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853 Sep 05 04:40:23 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:23 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140" returned: 0 in 0.403s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:23 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140 Sep 05 04:40:23 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:23 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.dcb3b382-588d-4776-836a-b8e307345853" returned: 0 in 0.353s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-dcb3b382-588d-4776-836a-b8e307345853" released by "_delete_snapshot" :: held 2.040s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" released by "delete_snapshot" :: held 2.068s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Created reservations ['88aeadfd-1aaf-417e-be5d-5dc78f584b7f', 'f675651f-862b-415d-ae19-06839cc2845d', '8100284b-be36-4f53-a495-c6d05bf443b2', 'f0d5ed1b-c907-48db-ae05-d7479926432d'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:23 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Delete snapshot completed successfully. Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d7231d52-2be4-4cc4-9d91-921c81656141 tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-dcb3b382-588d-4776-836a-b8e307345853-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:23 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2.fbe3f402-b067-4fd2-9a5a-f94da348b140" returned: 0 in 0.331s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-fbe3f402-b067-4fd2-9a5a-f94da348b140" released by "_delete_snapshot" :: held 2.027s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-08fe61b2-2e3c-4600-b810-91fe5f5116c2" released by "delete_snapshot" :: held 2.062s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:23 devstack cinder-volume[89807]: WARNING cinder.quota [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1743393164 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1743393164, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:23 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] Created reservations ['329f375f-ac92-4b4c-979d-83a8fa7d367f', '7f456c6c-0904-4083-a58f-d429f3455d58', '39b12e1c-fb6f-4eda-823f-a1c57555e2b3', 'd91e502e-bfdb-4c0a-9a8c-03f38a17e7d4'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:23 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5185ea4c-3771-4b25-b471-bca9f92ec04d tempest-GroupSnapshotsTest-941596947 None] group_snapshot 195119a8-d0b0-46c4-abc6-0b22d2f52b0c: deleted successfully Sep 05 04:40:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-08fe61b2-2e3c-4600-b810-91fe5f5116c2" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-08fe61b2-2e3c-4600-b810-91fe5f5116c2" acquired by "delete_volume" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:24 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[396b5785-9e03-477e-9b64-8e8c74481b2b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:24 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 Sep 05 04:40:24 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:24 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2" returned: 0 in 0.521s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:24 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2 Sep 05 04:40:24 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] Creating offline snapshot 01a9d5d2-cbab-4144-928c-0bd10ccf5400 of volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7aa310-790e-464e-8e75-f42d61002be9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:25 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08fe61b2-2e3c-4600-b810-91fe5f5116c2" returned: 0 in 0.327s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:25 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-08fe61b2-2e3c-4600-b810-91fe5f5116c2" released by "delete_volume" :: held 0.940s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:25 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Created reservations ['da5adb68-50a9-44e4-948a-31a699d0f3c9'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:25 devstack cinder-volume[89807]: WARNING cinder.db.api [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1743393164'] Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Created reservations ['b2ff30a7-5002-4f89-8bfb-8da9fa97d43e', '6268744e-fd5c-4ca5-b0e3-a73f512172d9', '8a7826c3-9828-4ce1-8620-53eaa553303a', '0053bd41-3cbd-4146-b9a1-878ce1daaa9f'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:25 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:40:25 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:25 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.478s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:25 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 1G Sep 05 04:40:25 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:25 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.280s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:25 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:40:25 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-724c1d1a-c0d9-46b6-95c5-99e3d883437a tempest-GroupSnapshotsTest-941596947 None] Delete group completed successfully. Sep 05 04:40:26 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 1G" returned: 0 in 0.577s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:26 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 Sep 05 04:40:26 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:26 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400" returned: 0 in 0.307s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:26 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 is being set with open permissions: ugo+rw Sep 05 04:40:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:26 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 Sep 05 04:40:26 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:26 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400" returned: 0 in 0.286s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:26 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=177,cinder:UPDATE=189,cinder:INSERT=47,cinder:DELETE=9 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:40:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:26 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6db0aca9-324f-4d9b-87cd-ec8bc369ef5a tempest-SnapshotsActionsTest-1124761940 None] Create snapshot completed successfully Sep 05 04:40:27 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0ea58b4d-ed80-4697-801d-a0b4d7521386 tempest-GroupSnapshotsTest-941596947 None] Group tempest-GroupSnapshotsTest-Group-1591263621: creating Sep 05 04:40:27 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0ea58b4d-ed80-4697-801d-a0b4d7521386 tempest-GroupSnapshotsTest-941596947 None] Group tempest-GroupSnapshotsTest-Group-1591263621: created successfully Sep 05 04:40:27 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0ea58b4d-ed80-4697-801d-a0b4d7521386 tempest-GroupSnapshotsTest-941596947 None] Create group completed successfully. Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-01a9d5d2-cbab-4144-928c-0bd10ccf5400-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-01a9d5d2-cbab-4144-928c-0bd10ccf5400-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Acquiring lock "cinder-quobyte-01a9d5d2-cbab-4144-928c-0bd10ccf5400" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-01a9d5d2-cbab-4144-928c-0bd10ccf5400" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Deleting offline snapshot 01a9d5d2-cbab-4144-928c-0bd10ccf5400 of volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] snapshot_file for this snap is: volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[607dcdd6-6c31-423c-869b-5069bb366709]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:27 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 Sep 05 04:40:27 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:27 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400" returned: 0 in 0.396s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e22c31-1ebe-4f53-a7af-14d39c122ba2]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:27 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:27 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:28 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.466s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:28 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 Sep 05 04:40:28 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:28 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400" returned: 0 in 0.496s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:28 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400 Sep 05 04:40:28 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Flow 'volume_create_manager' (3312c4cc-c3b4-4f77-86ee-f509dcd1fc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d295e32-7a55-4581-9de4-2248368265ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d295e32-7a55-4581-9de4-2248368265ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-648306509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69ffcccf-9e2d-4f61-82f4-5d5bd547bb74,host='devstack@QuobyteHD#QuobyteHD',id=3ccdfd99-e549-4c15-a5ac-c2590c380f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c116ad98bb842cfa19b45fe890c7f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:40:29Z,use_quota=True,user_id='d522a1ead1c247e1af2c065214149f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b8698ec-5687-4b7c-abeb-53990dfed8f0),volume_type_id=7b8698ec-5687-4b7c-abeb-53990dfed8f0)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3707977-0154-4035-b2de-536992549977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3707977-0154-4035-b2de-536992549977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:29 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3a32d4-87b6-4d95-bf71-78b57c49208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3a32d4-87b6-4d95-bf71-78b57c49208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ccdfd99-e549-4c15-a5ac-c2590c380f8a', 'volume_name': 'volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885b967f-cef5-4ea3-9794-8d2179e7baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885b967f-cef5-4ea3-9794-8d2179e7baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00de5df-f6cb-486e-8fae-f6c3f927c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Volume 3ccdfd99-e549-4c15-a5ac-c2590c380f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a', 'volume_size': 1} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=69ffcccf-9e2d-4f61-82f4-5d5bd547bb74,created_at=2026-09-05T02:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-648306509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69ffcccf-9e2d-4f61-82f4-5d5bd547bb74,host='devstack@QuobyteHD#QuobyteHD',id=3ccdfd99-e549-4c15-a5ac-c2590c380f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c116ad98bb842cfa19b45fe890c7f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:40:29Z,use_quota=True,user_id='d522a1ead1c247e1af2c065214149f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b8698ec-5687-4b7c-abeb-53990dfed8f0),volume_type_id=7b8698ec-5687-4b7c-abeb-53990dfed8f0)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Creating volume 3ccdfd99-e549-4c15-a5ac-c2590c380f8a {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:40:29 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.01a9d5d2-cbab-4144-928c-0bd10ccf5400" returned: 0 in 0.422s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:29 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a 1073741824 Sep 05 04:40:29 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-01a9d5d2-cbab-4144-928c-0bd10ccf5400" released by "_delete_snapshot" :: held 1.879s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" released by "delete_snapshot" :: held 1.908s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Created reservations ['ef8a6e30-2f01-44a2-b15f-0eb9ce1d0482', '355da044-57cd-4f62-a84e-7c3f5f3fbad4', '63dcce7c-d5ba-40ec-95c4-ff66a5e8e757', 'f3da04ee-044d-42ce-b72b-f719a1517c1b'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Delete snapshot completed successfully. Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f34a2718-6a8e-4986-b794-8d48bcb32b1a tempest-SnapshotsActionsTest-705557026 None] Lock "cinder-01a9d5d2-cbab-4144-928c-0bd10ccf5400-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:29 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a 1073741824" returned: 0 in 0.640s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:29 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a Sep 05 04:40:29 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "cinder-aacc81c4-128a-4991-bc0f-4b75f10efa26-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Lock "cinder-aacc81c4-128a-4991-bc0f-4b75f10efa26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "cinder-quobyte-aacc81c4-128a-4991-bc0f-4b75f10efa26" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Lock "cinder-quobyte-aacc81c4-128a-4991-bc0f-4b75f10efa26" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:30 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Deleting offline snapshot aacc81c4-128a-4991-bc0f-4b75f10efa26 of volume c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] snapshot_file for this snap is: volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" returned: 0 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2218ea2-7842-458e-aa2a-bd0e29b016eb]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00de5df-f6cb-486e-8fae-f6c3f927c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b39802c-132d-492b-a15f-03c8906e230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Volume volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a (3ccdfd99-e549-4c15-a5ac-c2590c380f8a): created successfully Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b39802c-132d-492b-a15f-03c8906e230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Flow 'volume_create_manager' (3312c4cc-c3b4-4f77-86ee-f509dcd1fc44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:40:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6c0ad099-9511-4580-b295-b5045ca2f6ca tempest-GroupSnapshotsTest-941596947 None] Created volume successfully. Sep 05 04:40:30 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:30 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:30 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.421s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4399394-625b-4f86-aeef-dc58d9b00ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f105e71-76fa-458f-8cb3-31b41347160c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:30 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 Sep 05 04:40:30 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:31 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2" returned: 0 in 0.451s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:31 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:31 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:31 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.386s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:31 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26 Sep 05 04:40:31 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:31 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2.aacc81c4-128a-4991-bc0f-4b75f10efa26" returned: 0 in 0.287s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Lock "cinder-quobyte-aacc81c4-128a-4991-bc0f-4b75f10efa26" released by "_delete_snapshot" :: held 1.735s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" released by "delete_snapshot" :: held 1.787s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Created reservations ['b9390a7a-109f-4a4b-b020-7e7d876255c0', 'e5b3315a-06f7-449f-b97a-0ea5a1cec835', '39f5fb0b-b2b3-45bf-ac78-7df2edca5a69', '990ee58c-c916-46a2-918e-d62ef641b128'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Delete snapshot completed successfully. Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9e5d94ee-0329-4b98-a48f-d40409acc325 tempest-SnapshotsActionsTest-1124761940 None] Lock "cinder-aacc81c4-128a-4991-bc0f-4b75f10efa26-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Flow 'volume_create_manager' (93a4ca70-a5cc-485c-8bcc-2c6fede4d71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba769a38-bb06-42ea-bc9f-f8d458a2ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "cinder-c4399394-625b-4f86-aeef-dc58d9b00ff2-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba769a38-bb06-42ea-bc9f-f8d458a2ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1600937240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69ffcccf-9e2d-4f61-82f4-5d5bd547bb74,host='devstack@QuobyteHD#QuobyteHD',id=038f44a5-0968-4fe3-b6a9-88ae075c0fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c116ad98bb842cfa19b45fe890c7f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:40:32Z,use_quota=True,user_id='d522a1ead1c247e1af2c065214149f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b8698ec-5687-4b7c-abeb-53990dfed8f0),volume_type_id=7b8698ec-5687-4b7c-abeb-53990dfed8f0)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bce8939-bb01-461c-8b29-9629c846e7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bce8939-bb01-461c-8b29-9629c846e7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4faddcbc-7d95-48dd-8b51-8ec01bae7321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4faddcbc-7d95-48dd-8b51-8ec01bae7321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038f44a5-0968-4fe3-b6a9-88ae075c0fb7', 'volume_name': 'volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c11abd-8a9e-49ad-8025-849f211d44a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c11abd-8a9e-49ad-8025-849f211d44a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bf803c-246a-447f-ae07-a5bf1af7709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:32 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Volume 038f44a5-0968-4fe3-b6a9-88ae075c0fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7', 'volume_size': 1} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=69ffcccf-9e2d-4f61-82f4-5d5bd547bb74,created_at=2026-09-05T02:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1600937240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69ffcccf-9e2d-4f61-82f4-5d5bd547bb74,host='devstack@QuobyteHD#QuobyteHD',id=038f44a5-0968-4fe3-b6a9-88ae075c0fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c116ad98bb842cfa19b45fe890c7f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:40:32Z,use_quota=True,user_id='d522a1ead1c247e1af2c065214149f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b8698ec-5687-4b7c-abeb-53990dfed8f0),volume_type_id=7b8698ec-5687-4b7c-abeb-53990dfed8f0)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Creating volume 038f44a5-0968-4fe3-b6a9-88ae075c0fb7 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:40:32 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Lock "cinder-c4399394-625b-4f86-aeef-dc58d9b00ff2-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:32 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 1073741824 Sep 05 04:40:32 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" acquired by "delete_volume" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e986cf9-dc2d-4e6f-8a48-008c5b056dc3]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:33 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 Sep 05 04:40:33 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:33 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 1073741824" returned: 0 in 0.620s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:33 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 Sep 05 04:40:33 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:33 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2" returned: 0 in 0.584s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:33 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2 Sep 05 04:40:33 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:33 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" returned: 0 in 0.408s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:33 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bf803c-246a-447f-ae07-a5bf1af7709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52345d0b-7841-4e6a-86af-d7d1abffa581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c4399394-625b-4f86-aeef-dc58d9b00ff2" returned: 0 in 0.351s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Lock "cinder-quobyte-c4399394-625b-4f86-aeef-dc58d9b00ff2" released by "delete_volume" :: held 1.016s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:33 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Volume volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 (038f44a5-0968-4fe3-b6a9-88ae075c0fb7): created successfully Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52345d0b-7841-4e6a-86af-d7d1abffa581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Flow 'volume_create_manager' (93a4ca70-a5cc-485c-8bcc-2c6fede4d71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:40:33 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5b4ced9d-cb57-415b-8f98-e68b821d3240 tempest-GroupSnapshotsTest-941596947 None] Created volume successfully. Sep 05 04:40:33 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Created reservations ['34e5d187-a1de-4df1-ae20-b17a7665e9da', '4fcec427-9818-48d8-ad85-57713146e460', '7dcdf530-3d1f-4617-ae21-16226954f7e8', 'e1b126cf-fe89-4cb8-9b38-d25d4a27c1f1'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:34 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:40:34 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:34 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.296s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:34 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:40:34 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Deleted volume successfully. Sep 05 04:40:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-be8fac27-a6d0-4fe1-bdb2-2f4c5e6a7229 tempest-SnapshotsActionsTest-1124761940 None] Lock "cinder-c4399394-625b-4f86-aeef-dc58d9b00ff2-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d3b5766b-b779-4a00-bd53-dcd4974ebeed tempest-GroupSnapshotsTest-941596947 None] Update group completed successfully. Sep 05 04:40:36 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5504885b-f1ef-4733-a4d5-64cb1b3825f7 tempest-GroupSnapshotsTest-941596947 None] Update group completed successfully. Sep 05 04:40:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-181c0e90-4198-4783-b265-b98e4826d584 tempest-GroupSnapshotsTest-941596947 None] Update group completed successfully. Sep 05 04:40:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6a233ffd-86b0-4911-ad30-72cd320a8dd7 tempest-GroupSnapshotsTest-941596947 None] Update group completed successfully. Sep 05 04:40:40 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] GroupSnapshot 8f336861-7d2f-482e-915e-d0cc3101468e: creating. Sep 05 04:40:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Group snapshot 8f336861-7d2f-482e-915e-d0cc3101468e: creating. {{(pid=89807) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 04:40:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Creating offline snapshot 0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd of volume 3ccdfd99-e549-4c15-a5ac-c2590c380f8a {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:40:40 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c96817-7d74-48ac-9403-9cbb9bf8d844]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:40 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a Sep 05 04:40:40 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" returned: 0 in 0.466s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:41 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:41 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd 1G Sep 05 04:40:41 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:41 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd 1G" returned: 0 in 0.534s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:41 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd Sep 05 04:40:41 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:42 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd" returned: 0 in 0.395s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:42 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:42 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd Sep 05 04:40:42 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Flow 'volume_create_manager' (5c49a6b2-9df9-4d72-a6b2-e533e7ee9309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829ff02b-f8c6-4161-a91f-9ed7ae967bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829ff02b-f8c6-4161-a91f-9ed7ae967bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1567355415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02541a6f-d6ea-4cb8-be63-1b584b17c417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba68b83bd9d4694a5a3fa8dce9eb0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:40:42Z,use_quota=True,user_id='780a75781efd4e9a8188a128b6ebac25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b162cda-41e6-4036-ac38-0b6b7cc05034),volume_type_id=4b162cda-41e6-4036-ac38-0b6b7cc05034)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daaddc31-febc-4b1e-8aa5-1ae4dc55b446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daaddc31-febc-4b1e-8aa5-1ae4dc55b446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087b0b62-15ed-47d2-ae0d-b50ed1eb13ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087b0b62-15ed-47d2-ae0d-b50ed1eb13ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02541a6f-d6ea-4cb8-be63-1b584b17c417', 'volume_name': 'volume-02541a6f-d6ea-4cb8-be63-1b584b17c417', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bb61f1-4d5c-4ead-9a4d-294b2c9627d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bb61f1-4d5c-4ead-9a4d-294b2c9627d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d510c3c5-a2ee-4249-ab50-d4b2a5effcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Volume 02541a6f-d6ea-4cb8-be63-1b584b17c417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02541a6f-d6ea-4cb8-be63-1b584b17c417', 'volume_size': 1} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:42 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd" returned: 0 in 0.303s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:42 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.info Sep 05 04:40:42 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:42 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.info" returned: 0 in 0.357s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:42 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:40:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:42 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.info Sep 05 04:40:42 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:43 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.info" returned: 0 in 0.262s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Creating offline snapshot e0d08b33-8fe5-4ea1-806c-e89ba23da42c of volume 038f44a5-0968-4fe3-b6a9-88ae075c0fb7 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:40:43 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[6768b0e0-00b5-4326-9c31-0c4fd3b6f988]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:43 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 Sep 05 04:40:43 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:43 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" returned: 0 in 0.385s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:43 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c 1G Sep 05 04:40:43 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:44 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c 1G" returned: 0 in 0.537s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:44 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c Sep 05 04:40:44 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:44 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c" returned: 0 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:44 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:40:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:44 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c Sep 05 04:40:44 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:44 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c" returned: 0 in 0.341s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:45 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.info Sep 05 04:40:45 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:45 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.info" returned: 0 in 0.394s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:45 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:45 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.info Sep 05 04:40:45 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:45 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.info" returned: 0 in 0.244s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.213s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1567355415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02541a6f-d6ea-4cb8-be63-1b584b17c417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba68b83bd9d4694a5a3fa8dce9eb0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:40:42Z,use_quota=True,user_id='780a75781efd4e9a8188a128b6ebac25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b162cda-41e6-4036-ac38-0b6b7cc05034),volume_type_id=4b162cda-41e6-4036-ac38-0b6b7cc05034)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Creating volume 02541a6f-d6ea-4cb8-be63-1b584b17c417 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:40:45 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:40:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:45 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417 1073741824 Sep 05 04:40:45 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-60c680f9-b77b-4112-8709-93af297b4140 tempest-GroupSnapshotsTest-941596947 None] group_snapshot 8f336861-7d2f-482e-915e-d0cc3101468e: created successfully Sep 05 04:40:46 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417 1073741824" returned: 0 in 0.569s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:46 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417 Sep 05 04:40:46 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] group_snapshot 8f336861-7d2f-482e-915e-d0cc3101468e: deleting Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] group_snapshot 8f336861-7d2f-482e-915e-d0cc3101468e: deleting {{(pid=89807) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Deleting offline snapshot 0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd of volume 3ccdfd99-e549-4c15-a5ac-c2590c380f8a {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] snapshot_file for this snap is: volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04ffb10-dea0-4743-81d3-7b5dfea2b986]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:46 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417" returned: 0 in 0.474s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d510c3c5-a2ee-4249-ab50-d4b2a5effcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02541a6f-d6ea-4cb8-be63-1b584b17c417', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ac88bf-a259-461c-8292-c04d85b6e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:46 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd Sep 05 04:40:46 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:46 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Volume volume-02541a6f-d6ea-4cb8-be63-1b584b17c417 (02541a6f-d6ea-4cb8-be63-1b584b17c417): created successfully Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ac88bf-a259-461c-8292-c04d85b6e301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Flow 'volume_create_manager' (5c49a6b2-9df9-4d72-a6b2-e533e7ee9309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:40:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-08155b47-0493-4de4-94d2-7dee26d9b9ba tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Created volume successfully. Sep 05 04:40:47 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd" returned: 0 in 0.618s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:47 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f0571a-9f24-47ce-b3d6-40721e150eb4]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:47 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a Sep 05 04:40:47 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:48 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" returned: 0 in 0.987s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:48 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd Sep 05 04:40:48 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5cd1b308-dde8-4774-9814-72de3c579efc tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5cd1b308-dde8-4774-9814-72de3c579efc tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1b308-dde8-4774-9814-72de3c579efc tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1b308-dde8-4774-9814-72de3c579efc tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5cd1b308-dde8-4774-9814-72de3c579efc tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5cd1b308-dde8-4774-9814-72de3c579efc tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:48 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:40:48 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:49 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd" returned: 0 in 0.798s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:49 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5cd1b308-dde8-4774-9814-72de3c579efc tempest-VolumeRetypeWithoutMigrationTest-565051893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.464s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-5cd1b308-dde8-4774-9814-72de3c579efc tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:40:49 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd Sep 05 04:40:49 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:49 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5cd1b308-dde8-4774-9814-72de3c579efc tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Retype volume completed successfully. Sep 05 04:40:49 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a.0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd" returned: 0 in 0.470s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-0fe9fdcd-3fb6-43c5-917d-6c83dcfbf1fd" released by "_delete_snapshot" :: held 3.042s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" released by "delete_snapshot" :: held 3.074s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-e0d08b33-8fe5-4ea1-806c-e89ba23da42c" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-e0d08b33-8fe5-4ea1-806c-e89ba23da42c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Deleting offline snapshot e0d08b33-8fe5-4ea1-806c-e89ba23da42c of volume 038f44a5-0968-4fe3-b6a9-88ae075c0fb7 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] snapshot_file for this snap is: volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4399f-1dc8-4c32-829b-fe27efd3191b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:49 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c Sep 05 04:40:49 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Acquiring lock "cinder-02541a6f-d6ea-4cb8-be63-1b584b17c417-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "cinder-02541a6f-d6ea-4cb8-be63-1b584b17c417-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:50 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c" returned: 0 in 0.543s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f073486-8e05-45d4-a36a-17431eaa04ca]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Acquiring lock "cinder-quobyte-02541a6f-d6ea-4cb8-be63-1b584b17c417" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "cinder-quobyte-02541a6f-d6ea-4cb8-be63-1b584b17c417" acquired by "delete_volume" :: waited 0.029s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42bc92a-c065-4bb7-a4e4-789b0f8ebe19]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:50 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 Sep 05 04:40:50 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:50 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417 Sep 05 04:40:50 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:50 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" returned: 0 in 0.559s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:50 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c Sep 05 04:40:50 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:50 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417" returned: 0 in 0.503s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:51 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417 Sep 05 04:40:51 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:51 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-02541a6f-d6ea-4cb8-be63-1b584b17c417" returned: 0 in 0.368s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "cinder-quobyte-02541a6f-d6ea-4cb8-be63-1b584b17c417" released by "delete_volume" :: held 0.937s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:DELETE=11,cinder:SELECT=156,cinder:UPDATE=145,cinder:INSERT=32 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:40:51 devstack cinder-volume[89807]: WARNING cinder.quota [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:51 devstack cinder-volume[89807]: WARNING cinder.quota [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Created reservations ['e52fce57-d61f-4997-89e7-5c3cb57c4499', '2f44dfcf-4803-45d6-bbb1-2663bb473df9', 'ab30dbc9-28a5-49d0-acae-500e4b616c01', 'a0b94289-019f-40e7-8174-a99674077cb4'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:51 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c" returned: 0 in 0.650s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:51 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c Sep 05 04:40:51 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:51 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:40:51 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:51 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7.e0d08b33-8fe5-4ea1-806c-e89ba23da42c" returned: 0 in 0.360s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-e0d08b33-8fe5-4ea1-806c-e89ba23da42c" released by "_delete_snapshot" :: held 2.292s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" released by "delete_snapshot" :: held 2.339s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:52 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.385s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:52 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:40:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Deleted volume successfully. Sep 05 04:40:52 devstack cinder-volume[89807]: WARNING cinder.quota [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-789804677 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-789804677, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:52 devstack cinder-volume[89807]: WARNING cinder.quota [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-789804677 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-789804677, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5da27054-ad57-47fc-bdca-dfcdb1b9cc91 tempest-VolumeRetypeWithoutMigrationTest-565051893 None] Lock "cinder-02541a6f-d6ea-4cb8-be63-1b584b17c417-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:52 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Created reservations ['de910c13-cbd6-42bc-ad50-90360d8c5b4a', '6809b46a-b53e-414c-8d4b-e9420e37b5a0', '7401039d-014e-4bc8-bbb6-5fd3c1f44687', '5c38ffb6-f634-4113-b41b-348c8868bf1a'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:52 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] Created reservations ['382fc4bd-a431-406f-abda-2bf145fe5c87', '30cd84e5-dd7e-496f-aabe-9335cad2be1b', 'ad9e0e59-d5b0-4320-8355-8e47c00818d1', 'b7bb7128-8637-4695-9e9e-291d5a143f2b'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b21b1227-1ac8-4809-88ff-e8717b6136ce tempest-GroupSnapshotsTest-941596947 None] group_snapshot 8f336861-7d2f-482e-915e-d0cc3101468e: deleted successfully Sep 05 04:40:54 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:54 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" acquired by "delete_volume" :: waited 0.053s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:54 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb0d6cb-de3d-41d3-8772-7c981e567049]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:54 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 Sep 05 04:40:54 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:55 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" returned: 0 in 0.522s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:55 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7 Sep 05 04:40:55 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:55 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" returned: 0 in 0.395s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-038f44a5-0968-4fe3-b6a9-88ae075c0fb7" released by "delete_volume" :: held 1.040s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:40:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:40:55 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[81921c63-fab1-4269-938b-3ed2b258ef69]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:40:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:55 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a Sep 05 04:40:55 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:56 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" returned: 0 in 0.593s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:56 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a Sep 05 04:40:56 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:56 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" returned: 0 in 0.384s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-3ccdfd99-e549-4c15-a5ac-c2590c380f8a" released by "delete_volume" :: held 1.061s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:40:56 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Created reservations ['bb47603f-9ff4-42a2-ab15-bf9998da1a5a'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:56 devstack cinder-volume[89807]: WARNING cinder.quota [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-789804677 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-789804677, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:40:56 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Created reservations ['7aa56965-e04f-4673-951c-5563ccb0c794', '213b63aa-b425-43ea-8dda-356eeceb380a', '6cb39a1d-ce4b-40f8-97ff-dc3e626920a3', '642e24f1-77dc-4be5-9816-4448abbee598'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:56 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Created reservations ['d55699f3-5a85-49c2-82f7-b3365c5e48af', 'c13f72b5-4782-4e49-b79c-40e43be15c58', 'a9e702b4-b44d-4654-b690-2f53a5eae5b3', 'ecbec225-6689-48f7-bb0c-9edd8843a505'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:40:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:57 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:40:57 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:40:57 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Sep 05 04:40:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.491s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:40:57 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:40:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-bba2618f-8e1c-4e74-b6a0-234b9fee23b5 tempest-GroupSnapshotsTest-941596947 None] Delete group completed successfully. Sep 05 04:40:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0cd4fce2-7a82-4153-b245-59f9512a916e tempest-GroupSnapshotsTest-941596947 None] Group tempest-GroupSnapshotsTest-Group-650447102: creating Sep 05 04:40:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0cd4fce2-7a82-4153-b245-59f9512a916e tempest-GroupSnapshotsTest-941596947 None] Group tempest-GroupSnapshotsTest-Group-650447102: created successfully Sep 05 04:40:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0cd4fce2-7a82-4153-b245-59f9512a916e tempest-GroupSnapshotsTest-941596947 None] Create group completed successfully. Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Flow 'volume_create_manager' (3ea3e1e1-92cb-4a34-b98c-74fd7263404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebd605b-6ed1-42d6-b854-b18459f811be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebd605b-6ed1-42d6-b854-b18459f811be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-413414256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16c8e1c4-d1f7-4ddb-9995-717905a30710,host='devstack@QuobyteHD#QuobyteHD',id=c225aa7f-7043-4fd2-aecf-0b4ea132c742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c116ad98bb842cfa19b45fe890c7f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:00Z,use_quota=True,user_id='d522a1ead1c247e1af2c065214149f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ace6ddb6-3ad9-43dd-ba75-bbbe99d0cce0),volume_type_id=ace6ddb6-3ad9-43dd-ba75-bbbe99d0cce0)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cd8e68-608e-4f22-931c-95a9811093a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cd8e68-608e-4f22-931c-95a9811093a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cda0cf-5b48-485d-b6f9-a7d82b65c649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cda0cf-5b48-485d-b6f9-a7d82b65c649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c225aa7f-7043-4fd2-aecf-0b4ea132c742', 'volume_name': 'volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9616f26-71af-4adf-8f2c-31b4a312ff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9616f26-71af-4adf-8f2c-31b4a312ff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbf87bb-df8c-4071-973a-50f810992f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:40:59 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Volume c225aa7f-7043-4fd2-aecf-0b4ea132c742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742', 'volume_size': 1} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=16c8e1c4-d1f7-4ddb-9995-717905a30710,created_at=2026-09-05T02:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-413414256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16c8e1c4-d1f7-4ddb-9995-717905a30710,host='devstack@QuobyteHD#QuobyteHD',id=c225aa7f-7043-4fd2-aecf-0b4ea132c742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c116ad98bb842cfa19b45fe890c7f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:00Z,use_quota=True,user_id='d522a1ead1c247e1af2c065214149f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ace6ddb6-3ad9-43dd-ba75-bbbe99d0cce0),volume_type_id=ace6ddb6-3ad9-43dd-ba75-bbbe99d0cce0)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Creating volume c225aa7f-7043-4fd2-aecf-0b4ea132c742 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:40:59 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:40:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:40:59 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 1073741824 Sep 05 04:40:59 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:00 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 1073741824" returned: 0 in 0.555s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:00 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 Sep 05 04:41:00 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:00 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742" returned: 0 in 0.424s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbf87bb-df8c-4071-973a-50f810992f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b98696-280c-4a55-8e43-0b5998fc9cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:00 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Volume volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 (c225aa7f-7043-4fd2-aecf-0b4ea132c742): created successfully Sep 05 04:41:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b98696-280c-4a55-8e43-0b5998fc9cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Flow 'volume_create_manager' (3ea3e1e1-92cb-4a34-b98c-74fd7263404b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:00 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ed965bbf-e7cc-433d-972d-4ba71bdbc460 tempest-GroupSnapshotsTest-941596947 None] Created volume successfully. Sep 05 04:41:02 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] GroupSnapshot 1401689d-8697-4e49-bab1-e7b9f96758f9: creating. Sep 05 04:41:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Group snapshot 1401689d-8697-4e49-bab1-e7b9f96758f9: creating. {{(pid=89807) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 04:41:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Creating offline snapshot 25b00743-4672-4013-a116-ab12f0d352e6 of volume c225aa7f-7043-4fd2-aecf-0b4ea132c742 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:41:02 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dc5597-2eef-4330-b151-a26d80b89b32]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:02 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 Sep 05 04:41:02 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:02 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742" returned: 0 in 0.407s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:02 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 1G Sep 05 04:41:02 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:03 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 1G" returned: 0 in 0.483s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:03 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 Sep 05 04:41:03 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:03 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6" returned: 0 in 0.372s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:03 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:41:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:03 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 Sep 05 04:41:03 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:04 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6" returned: 0 in 0.279s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:04 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.info Sep 05 04:41:04 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:04 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.info" returned: 0 in 0.264s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:04 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:41:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:04 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.info Sep 05 04:41:04 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:04 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.info" returned: 0 in 0.293s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:04 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5aa3508d-aa7a-46b3-a678-c17d1703dc19 tempest-GroupSnapshotsTest-941596947 None] group_snapshot 1401689d-8697-4e49-bab1-e7b9f96758f9: created successfully Sep 05 04:41:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] group_snapshot 1401689d-8697-4e49-bab1-e7b9f96758f9: deleting Sep 05 04:41:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] group_snapshot 1401689d-8697-4e49-bab1-e7b9f96758f9: deleting {{(pid=89807) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 04:41:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-c225aa7f-7043-4fd2-aecf-0b4ea132c742" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-c225aa7f-7043-4fd2-aecf-0b4ea132c742" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-25b00743-4672-4013-a116-ab12f0d352e6" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-25b00743-4672-4013-a116-ab12f0d352e6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Deleting offline snapshot 25b00743-4672-4013-a116-ab12f0d352e6 of volume c225aa7f-7043-4fd2-aecf-0b4ea132c742 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:41:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] snapshot_file for this snap is: volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:41:06 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5602b05-b183-4a65-815a-9a0d98e12a9f]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:06 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 Sep 05 04:41:06 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:06 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6" returned: 0 in 0.465s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:41:06 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1762b4e9-921a-4475-be9e-548a42bec60c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:06 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 Sep 05 04:41:06 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:07 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742" returned: 0 in 0.503s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:07 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 Sep 05 04:41:07 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:07 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6" returned: 0 in 0.375s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:07 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6 Sep 05 04:41:07 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:07 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742.25b00743-4672-4013-a116-ab12f0d352e6" returned: 0 in 0.275s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-25b00743-4672-4013-a116-ab12f0d352e6" released by "_delete_snapshot" :: held 1.772s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-c225aa7f-7043-4fd2-aecf-0b4ea132c742" released by "delete_snapshot" :: held 1.804s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:07 devstack cinder-volume[89807]: WARNING cinder.quota [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1518203584 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1518203584, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:41:07 devstack cinder-volume[89807]: WARNING cinder.quota [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1518203584 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1518203584, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:41:07 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] Created reservations ['f06c847e-64aa-42a7-8edf-7e2368cf7830', 'eb95da2b-18ba-4a56-8b37-0877d7031d15', '60993fa4-d342-4c1c-a901-5e62b4093ea0', 'aa5ac0c8-7038-4a7a-aba3-ef4b592b8ab2'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:07 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-05177a48-b5ce-44d0-902d-4721e03a9ba4 tempest-GroupSnapshotsTest-941596947 None] group_snapshot 1401689d-8697-4e49-bab1-e7b9f96758f9: deleted successfully Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "cinder-quobyte-c225aa7f-7043-4fd2-aecf-0b4ea132c742" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-c225aa7f-7043-4fd2-aecf-0b4ea132c742" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1e6fef-cdc8-4c54-8478-610a79146785]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Flow 'volume_create_manager' (4b49c08a-cf60-4bf3-8997-99ee9d96f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632bbb03-98e8-4a0d-9e1b-5c08ffa073c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:08 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 Sep 05 04:41:08 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632bbb03-98e8-4a0d-9e1b-5c08ffa073c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-472731163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8031a06-0300-4a39-9a1d-750180183f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fc3d9561e274075ba79324e6e85ed70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:09Z,use_quota=True,user_id='a7ed0660b275436f90820831956fdde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08595605-6389-4f3d-ba22-6043bba7b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08595605-6389-4f3d-ba22-6043bba7b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1abba3f-d5e3-45fb-a34f-1ff38f4e8205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:08 devstack cinder-volume[89807]: DEBUG cinder.image.glance [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Creating Keystone auth plugin from conf {{(pid=89807) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 04:41:09 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742" returned: 0 in 0.460s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:09 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742 Sep 05 04:41:09 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1abba3f-d5e3-45fb-a34f-1ff38f4e8205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8031a06-0300-4a39-9a1d-750180183f23', 'volume_name': 'volume-b8031a06-0300-4a39-9a1d-750180183f23', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b4ef95-d136-4b3d-b0ca-a1bf970e1f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b4ef95-d136-4b3d-b0ca-a1bf970e1f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e29fca-66ef-46a4-9ac8-72fe4d1a131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:09 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Volume b8031a06-0300-4a39-9a1d-750180183f23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8031a06-0300-4a39-9a1d-750180183f23', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Trying to clone b8031a06-0300-4a39-9a1d-750180183f23 from image d96433d1-6b83-48c1-88e8-5f747cd5fb19 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]). {{(pid=89807) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 04:41:09 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c225aa7f-7043-4fd2-aecf-0b4ea132c742" returned: 0 in 0.345s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Lock "cinder-quobyte-c225aa7f-7043-4fd2-aecf-0b4ea132c742" released by "delete_volume" :: held 0.897s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Created reservations ['fcda59e0-997a-49c3-a4d1-370b3ff884e3'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:09 devstack cinder-volume[89807]: WARNING cinder.quota [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1518203584 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1518203584, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:41:09 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Created reservations ['1bd5e6e0-2f02-4aba-9524-7c3cf64ece32', '2fa41a2d-5104-4482-b81c-09994ae11eeb', '2f822420-04b3-49f0-abce-41ca9e5e95a9', '81849202-be5a-4a7a-aa72-72bc5dc74491'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 04:41:10 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Image download 20.69 MB at 20.69 MB/s Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e503ee-4abd-4ff3-901f-7683ac57e65d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:10 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:41:10 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:10 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD Sep 05 04:41:10 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:10 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.271s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:41:10 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e31e3823-3c2f-46e3-9cbe-1628aa1bb95a tempest-GroupSnapshotsTest-941596947 None] Delete group completed successfully. Sep 05 04:41:10 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Temporary image d96433d1-6b83-48c1-88e8-5f747cd5fb19 is fetched for user a7ed0660b275436f90820831956fdde3. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:10 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:41:10 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9156ee5-d643-42b9-93f1-421c0dea7464]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:10 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD Sep 05 04:41:10 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:11 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.439s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 28 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:41:11 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD" returned: 0 in 0.681s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-472731163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8031a06-0300-4a39-9a1d-750180183f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fc3d9561e274075ba79324e6e85ed70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:09Z,use_quota=True,user_id='a7ed0660b275436f90820831956fdde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Creating volume b8031a06-0300-4a39-9a1d-750180183f23 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:11 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:11 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 1073741824 Sep 05 04:41:11 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:12 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 1073741824" returned: 0 in 0.710s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:12 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 Sep 05 04:41:12 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:12 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23" returned: 0 in 0.507s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:12 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Attempting download of d96433d1-6b83-48c1-88e8-5f747cd5fb19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}])) to volume b8031a06-0300-4a39-9a1d-750180183f23. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 04:41:12 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[9076acb4-5fc5-4d05-8bd6-8f422820c95c]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_fnfs60m6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:13 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_fnfs60m6 Sep 05 04:41:13 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:13 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_fnfs60m6" returned: 0 in 0.496s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_fnfs60m6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:13 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_fnfs60m6 Sep 05 04:41:13 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:13 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_fnfs60m6" returned: 1 in 0.427s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_fnfs60m6' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:41:13 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce34112-8a78-4f63-a13a-86b64870e5ae]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:13 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD Sep 05 04:41:13 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:14 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD" returned: 0 in 0.417s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:14 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] d96433d1-6b83-48c1-88e8-5f747cd5fb19 was qcow2, converting to qcow2 {{(pid=89807) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 04:41:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:14 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 Sep 05 04:41:14 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Flow 'volume_create_manager' (c5a1d862-29d3-4945-8a51-25cd5771d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ad818d-3868-41b1-b32a-47975ae9a2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ad818d-3868-41b1-b32a-47975ae9a2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1534513288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d718e0f7-9eb0-4921-84a0-3d406a1ab7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78abc04c12064619ad2e1460194ac140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:16Z,use_quota=True,user_id='5cb64b67e81a418b8f55a473bc6da26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff9b2b9-cd02-4c20-9511-8054dca89009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff9b2b9-cd02-4c20-9511-8054dca89009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f4d84d-3128-4138-b467-ff122a59e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f4d84d-3128-4138-b467-ff122a59e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd718e0f7-9eb0-4921-84a0-3d406a1ab7bf', 'volume_name': 'volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4102065c-cc28-4456-aced-60c014b486ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4102065c-cc28-4456-aced-60c014b486ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7c5b94-f8b6-440c-b858-102a39e65298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:15 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Volume d718e0f7-9eb0-4921-84a0-3d406a1ab7bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf', 'volume_size': 1} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1534513288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d718e0f7-9eb0-4921-84a0-3d406a1ab7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78abc04c12064619ad2e1460194ac140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:16Z,use_quota=True,user_id='5cb64b67e81a418b8f55a473bc6da26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Creating volume d718e0f7-9eb0-4921-84a0-3d406a1ab7bf {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:15 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:15 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf 1073741824 Sep 05 04:41:15 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:16 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf 1073741824" returned: 0 in 0.833s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:16 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf Sep 05 04:41:16 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:16 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23" returned: 0 in 2.712s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:16 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_45xz81l2devstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:41:16 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Converted 112.00 MB image at 41.23 MB/s Sep 05 04:41:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:16 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 1G Sep 05 04:41:16 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:17 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf" returned: 0 in 0.430s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7c5b94-f8b6-440c-b858-102a39e65298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1794ca62-14a2-4a06-a4f8-42549021bc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:17 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Volume volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf (d718e0f7-9eb0-4921-84a0-3d406a1ab7bf): created successfully Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1794ca62-14a2-4a06-a4f8-42549021bc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Flow 'volume_create_manager' (c5a1d862-29d3-4945-8a51-25cd5771d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d6cac953-7289-4ad3-86b8-dbb5fcdd3857 tempest-ServerActionsTestOtherA-289008059 None] Created volume successfully. Sep 05 04:41:17 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 1G" returned: 0 in 0.448s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Downloaded image d96433d1-6b83-48c1-88e8-5f747cd5fb19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}])) to volume b8031a06-0300-4a39-9a1d-750180183f23 successfully. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Temporary image d96433d1-6b83-48c1-88e8-5f747cd5fb19 for user a7ed0660b275436f90820831956fdde3 is deleted. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Marking volume b8031a06-0300-4a39-9a1d-750180183f23 as bootable. {{(pid=89807) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Copying metadata from image d96433d1-6b83-48c1-88e8-5f747cd5fb19 to b8031a06-0300-4a39-9a1d-750180183f23. {{(pid=89807) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Creating volume glance metadata for volume b8031a06-0300-4a39-9a1d-750180183f23 backed by image d96433d1-6b83-48c1-88e8-5f747cd5fb19 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89807) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e29fca-66ef-46a4-9ac8-72fe4d1a131f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8031a06-0300-4a39-9a1d-750180183f23', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa44c1c9-a5f8-4a1c-bbf6-57ea22789664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:17 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Volume volume-b8031a06-0300-4a39-9a1d-750180183f23 (b8031a06-0300-4a39-9a1d-750180183f23): created successfully Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa44c1c9-a5f8-4a1c-bbf6-57ea22789664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Flow 'volume_create_manager' (4b49c08a-cf60-4bf3-8997-99ee9d96f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-bc92253a-ef82-4707-b08d-6f77c0af515e tempest-VolumesImageMetadata-310034175 None] Created volume successfully. Sep 05 04:41:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Acquiring lock "cinder-b8031a06-0300-4a39-9a1d-750180183f23-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Lock "cinder-b8031a06-0300-4a39-9a1d-750180183f23-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Acquiring lock "cinder-quobyte-b8031a06-0300-4a39-9a1d-750180183f23" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Lock "cinder-quobyte-b8031a06-0300-4a39-9a1d-750180183f23" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:19 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b474fce-87d0-43b7-9fab-ee2db91fee5a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:19 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 Sep 05 04:41:19 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:19 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23" returned: 0 in 0.567s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:19 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23 Sep 05 04:41:19 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:19 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8031a06-0300-4a39-9a1d-750180183f23" returned: 0 in 0.308s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Lock "cinder-quobyte-b8031a06-0300-4a39-9a1d-750180183f23" released by "delete_volume" :: held 0.938s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Created reservations ['093db53d-a871-4d34-b573-d8755f4ce3b1', '406974f1-832a-4edf-a01f-2a03702e1c5c', 'c3462b55-be53-4d58-89f7-161ec272714c', 'ecdda0db-40ae-49f6-9410-5a40b92a594e'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:20 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:41:20 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:20 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.297s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:41:20 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Deleted volume successfully. Sep 05 04:41:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-349d1001-42a0-46c0-a7db-9fab4e646a90 tempest-VolumesImageMetadata-310034175 None] Lock "cinder-b8031a06-0300-4a39-9a1d-750180183f23-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=124,cinder:UPDATE=120,cinder:INSERT=37,cinder:DELETE=6 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Flow 'volume_create_manager' (49df98fd-5d58-4845-a911-a9b76831a071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5cc382-0629-4ddc-8e9b-d4c2d4755c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5cc382-0629-4ddc-8e9b-d4c2d4755c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2046727770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2f69fb-e018-4d2b-8e3f-f7af20d90989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a6149c37f247be891bf31630cd6eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:28Z,use_quota=True,user_id='d0c694adcd2144b4a6f1a211aed7fa3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c6852e-f37a-4167-a9e5-552e4c779407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c6852e-f37a-4167-a9e5-552e4c779407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c499a281-8c37-4d98-aa02-cb4ddd49942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c499a281-8c37-4d98-aa02-cb4ddd49942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2f69fb-e018-4d2b-8e3f-f7af20d90989', 'volume_name': 'volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b8d93e-8b10-462b-bc46-5cf72cd4f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b8d93e-8b10-462b-bc46-5cf72cd4f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e7c5f3-abd8-4c00-9f6a-090839c8f085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:27 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Volume 3e2f69fb-e018-4d2b-8e3f-f7af20d90989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989', 'volume_size': 1} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2046727770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2f69fb-e018-4d2b-8e3f-f7af20d90989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a6149c37f247be891bf31630cd6eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:28Z,use_quota=True,user_id='d0c694adcd2144b4a6f1a211aed7fa3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Creating volume 3e2f69fb-e018-4d2b-8e3f-f7af20d90989 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:27 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:28 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989 1073741824 Sep 05 04:41:28 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:28 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989 1073741824" returned: 0 in 0.720s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:28 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989 Sep 05 04:41:28 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:29 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989" returned: 0 in 0.400s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e7c5f3-abd8-4c00-9f6a-090839c8f085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceecea7a-5918-45f2-be0b-576a34fe31ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Volume volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989 (3e2f69fb-e018-4d2b-8e3f-f7af20d90989): created successfully Sep 05 04:41:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceecea7a-5918-45f2-be0b-576a34fe31ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Flow 'volume_create_manager' (49df98fd-5d58-4845-a911-a9b76831a071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-14e7aa2a-baeb-4af1-a45b-20766217f136 tempest-AbsoluteLimitsTests-820975998 None] Created volume successfully. Sep 05 04:41:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Acquiring lock "cinder-3e2f69fb-e018-4d2b-8e3f-f7af20d90989-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Lock "cinder-3e2f69fb-e018-4d2b-8e3f-f7af20d90989-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Acquiring lock "cinder-quobyte-3e2f69fb-e018-4d2b-8e3f-f7af20d90989" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Lock "cinder-quobyte-3e2f69fb-e018-4d2b-8e3f-f7af20d90989" acquired by "delete_volume" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:31 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1699bad1-9443-44de-b627-6571cfac8db8]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:31 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989 Sep 05 04:41:31 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:31 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989" returned: 0 in 0.575s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:31 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989 Sep 05 04:41:31 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:32 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3e2f69fb-e018-4d2b-8e3f-f7af20d90989" returned: 0 in 0.435s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Lock "cinder-quobyte-3e2f69fb-e018-4d2b-8e3f-f7af20d90989" released by "delete_volume" :: held 1.131s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Created reservations ['a1099f50-7105-4906-a91c-c0133814538b', '2c7e90cf-eb84-44a3-9a58-f1fc048e5b46', 'a12913bd-513d-4d98-b849-5dd0a825e29a', 'e913d482-4964-48ab-84f2-71358651862d'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:32 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:41:32 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:32 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.435s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:41:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Deleted volume successfully. Sep 05 04:41:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-17bb61ef-187c-4dd6-9d22-54a29ecb7ca8 tempest-AbsoluteLimitsTests-820975998 None] Lock "cinder-3e2f69fb-e018-4d2b-8e3f-f7af20d90989-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e4b474c0-9c8e-4889-b8a3-cf7049e26e27 tempest-GroupsTest-810610500 None] Group tempest-Group1-1145914077: creating Sep 05 04:41:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e4b474c0-9c8e-4889-b8a3-cf7049e26e27 tempest-GroupsTest-810610500 None] Group tempest-Group1-1145914077: created successfully Sep 05 04:41:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e4b474c0-9c8e-4889-b8a3-cf7049e26e27 tempest-GroupsTest-810610500 None] Create group completed successfully. Sep 05 04:41:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0c3216a0-77fa-4caf-bafe-27e07a84d4ba tempest-GroupsTest-810610500 None] Group tempest-Group2-1538174038: creating Sep 05 04:41:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0c3216a0-77fa-4caf-bafe-27e07a84d4ba tempest-GroupsTest-810610500 None] Group tempest-Group2-1538174038: created successfully Sep 05 04:41:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0c3216a0-77fa-4caf-bafe-27e07a84d4ba tempest-GroupsTest-810610500 None] Create group completed successfully. Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Flow 'volume_create_manager' (eafdff0a-3b3d-4929-bda2-f043f849196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a8aeba-d36a-4373-babf-b35bd27eb8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a8aeba-d36a-4373-babf-b35bd27eb8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1901578635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=246aba7a-2020-4d77-9113-8cc822af11e4,host='devstack@QuobyteHD#QuobyteHD',id=da00f9bc-01f7-44e3-9f26-8641796bbd22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae89a6b678145298eaa87b277bc969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:41Z,use_quota=True,user_id='57311191f0bf4d039187ec086afb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb6c58be-ea2a-4f65-8e7b-599d9dc36dd7),volume_type_id=eb6c58be-ea2a-4f65-8e7b-599d9dc36dd7)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f654a18-7330-4631-b871-e5de6462a3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f654a18-7330-4631-b871-e5de6462a3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cc0f32-7679-44e7-8f4e-20715af36c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cc0f32-7679-44e7-8f4e-20715af36c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da00f9bc-01f7-44e3-9f26-8641796bbd22', 'volume_name': 'volume-da00f9bc-01f7-44e3-9f26-8641796bbd22', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e693fd-16ae-411c-8911-14b64617d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e693fd-16ae-411c-8911-14b64617d71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cefa83-8ada-421c-9686-f18089e163a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Volume da00f9bc-01f7-44e3-9f26-8641796bbd22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da00f9bc-01f7-44e3-9f26-8641796bbd22', 'volume_size': 1} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=246aba7a-2020-4d77-9113-8cc822af11e4,created_at=2026-09-05T02:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1901578635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=246aba7a-2020-4d77-9113-8cc822af11e4,host='devstack@QuobyteHD#QuobyteHD',id=da00f9bc-01f7-44e3-9f26-8641796bbd22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae89a6b678145298eaa87b277bc969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:41Z,use_quota=True,user_id='57311191f0bf4d039187ec086afb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb6c58be-ea2a-4f65-8e7b-599d9dc36dd7),volume_type_id=eb6c58be-ea2a-4f65-8e7b-599d9dc36dd7)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Creating volume da00f9bc-01f7-44e3-9f26-8641796bbd22 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:41 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:41 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22 1073741824 Sep 05 04:41:41 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:42 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22 1073741824" returned: 0 in 0.764s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:42 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22 Sep 05 04:41:42 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (6b5b82be-b017-4133-b7c0-072f003d8675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99fee87-84e4-4ba9-a72e-2bd959cc46cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99fee87-84e4-4ba9-a72e-2bd959cc46cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-73221067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e486d32c-62a3-4bcb-96b1-d79deb5be6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:43Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebae39b3-a9a8-436b-9f3d-cc4a61e78a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebae39b3-a9a8-436b-9f3d-cc4a61e78a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcbe717-9aac-453b-804d-ee2847d85e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcbe717-9aac-453b-804d-ee2847d85e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e486d32c-62a3-4bcb-96b1-d79deb5be6dd', 'volume_name': 'volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee4e90a-f87f-46af-bf1c-20479c369737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee4e90a-f87f-46af-bf1c-20479c369737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea4a09d-c09a-4869-92f4-4d3610ec3f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Volume e486d32c-62a3-4bcb-96b1-d79deb5be6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd', 'volume_size': 1} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:42 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22" returned: 0 in 0.645s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.048s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-73221067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e486d32c-62a3-4bcb-96b1-d79deb5be6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:43Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Creating volume e486d32c-62a3-4bcb-96b1-d79deb5be6dd {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:42 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:42 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd 1073741824 Sep 05 04:41:42 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cefa83-8ada-421c-9686-f18089e163a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da00f9bc-01f7-44e3-9f26-8641796bbd22', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e407a0da-d10d-48c1-b394-0a67936fa884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Volume volume-da00f9bc-01f7-44e3-9f26-8641796bbd22 (da00f9bc-01f7-44e3-9f26-8641796bbd22): created successfully Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e407a0da-d10d-48c1-b394-0a67936fa884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Flow 'volume_create_manager' (eafdff0a-3b3d-4929-bda2-f043f849196f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-718a5ab3-bd88-41ea-a1ea-d35a8434bbf2 tempest-GroupsTest-810610500 None] Created volume successfully. Sep 05 04:41:43 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd 1073741824" returned: 0 in 0.631s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:43 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd Sep 05 04:41:43 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:43 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd" returned: 0 in 0.351s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea4a09d-c09a-4869-92f4-4d3610ec3f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197f1818-bcb1-4d44-bc6a-5a06fbebcebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:43 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Volume volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd (e486d32c-62a3-4bcb-96b1-d79deb5be6dd): created successfully Sep 05 04:41:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197f1818-bcb1-4d44-bc6a-5a06fbebcebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (6b5b82be-b017-4133-b7c0-072f003d8675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:43 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a4d179d1-40eb-497c-9a67-bb8aab6315c6 tempest-VolumesActionsTest-1268879803 None] Created volume successfully. Sep 05 04:41:43 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Flow 'volume_create_manager' (bcfef881-f34e-46c7-be41-2090b53e9713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb736d4-09a8-49da-8d04-7e93aaccf888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb736d4-09a8-49da-8d04-7e93aaccf888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-449079629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c36b85dcb34a068032103b5c382d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:44Z,use_quota=True,user_id='ebb57db8e2aa4294bc35db482ff25e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de76b93e-6870-4ccb-b076-a1f08d5d5248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de76b93e-6870-4ccb-b076-a1f08d5d5248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebc9425-861b-4928-925f-bae0db0aacea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebc9425-861b-4928-925f-bae0db0aacea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a', 'volume_name': 'volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0c7963-6c26-42ff-bbaa-657a665a82b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0c7963-6c26-42ff-bbaa-657a665a82b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c6eb9e-8f12-4962-a1cb-ac39005a64c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:44 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Volume d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a', 'volume_size': 1} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-449079629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c36b85dcb34a068032103b5c382d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:44Z,use_quota=True,user_id='ebb57db8e2aa4294bc35db482ff25e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Creating volume d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:44 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:44 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a 1073741824 Sep 05 04:41:44 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:44 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a 1073741824" returned: 0 in 0.451s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:44 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a Sep 05 04:41:44 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Acquiring lock "cinder-quobyte-da00f9bc-01f7-44e3-9f26-8641796bbd22" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ba0e34be-1cab-4436-97a9-0fb63703a22a tempest-VolumesActionsTest-1268879803 None] Acquiring lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd" by "attach_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Lock "cinder-quobyte-da00f9bc-01f7-44e3-9f26-8641796bbd22" acquired by "delete_volume" :: waited 0.040s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ba0e34be-1cab-4436-97a9-0fb63703a22a tempest-VolumesActionsTest-1268879803 None] Lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd" acquired by "attach_volume" :: waited 0.045s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7e58cb-96ce-4dec-8d89-a64a9e57feec]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:45 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" returned: 0 in 0.473s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c6eb9e-8f12-4962-a1cb-ac39005a64c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:45 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22 Sep 05 04:41:45 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff34685-a85e-4456-928f-80f2a4f76aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ba0e34be-1cab-4436-97a9-0fb63703a22a tempest-VolumesActionsTest-1268879803 None] Attaching volume e486d32c-62a3-4bcb-96b1-d79deb5be6dd to instance 050913a4-757b-4d2d-9a15-a7f992905e33 at mountpoint /dev/vdb on host None. Sep 05 04:41:45 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Volume volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a (d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a): created successfully Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff34685-a85e-4456-928f-80f2a4f76aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Flow 'volume_create_manager' (bcfef881-f34e-46c7-be41-2090b53e9713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ba0e34be-1cab-4436-97a9-0fb63703a22a tempest-VolumesActionsTest-1268879803 None] Attach volume completed successfully. Sep 05 04:41:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0768d787-95a3-42b2-971c-7e2d5c8b420a tempest-VolumesDeleteCascade-270594991 None] Created volume successfully. Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ba0e34be-1cab-4436-97a9-0fb63703a22a tempest-VolumesActionsTest-1268879803 None] Lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd" released by "attach_volume" :: held 0.360s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:45 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22" returned: 0 in 0.605s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:45 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22 Sep 05 04:41:45 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:45 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-da00f9bc-01f7-44e3-9f26-8641796bbd22" returned: 0 in 0.341s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Lock "cinder-quobyte-da00f9bc-01f7-44e3-9f26-8641796bbd22" released by "delete_volume" :: held 1.032s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-792a2f75-6419-4769-8322-7e63fb1db8b8 tempest-VolumesActionsTest-65974355 None] Terminate volume connection completed successfully. Sep 05 04:41:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-792a2f75-6419-4769-8322-7e63fb1db8b8 tempest-VolumesActionsTest-65974355 None] Acquiring lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd-detach_volume" by "detach_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-792a2f75-6419-4769-8322-7e63fb1db8b8 tempest-VolumesActionsTest-65974355 None] Lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-792a2f75-6419-4769-8322-7e63fb1db8b8 tempest-VolumesActionsTest-65974355 None] Detaching volume e486d32c-62a3-4bcb-96b1-d79deb5be6dd from instance 050913a4-757b-4d2d-9a15-a7f992905e33. Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Created reservations ['c1527e7f-47e5-4f8c-973b-ed21aadef6b1'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-792a2f75-6419-4769-8322-7e63fb1db8b8 tempest-VolumesActionsTest-65974355 None] Detach volume completed successfully. Sep 05 04:41:46 devstack cinder-volume[89807]: WARNING cinder.quota [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1027351200 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1027351200, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:41:46 devstack cinder-volume[89807]: WARNING cinder.quota [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1027351200 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1027351200, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-792a2f75-6419-4769-8322-7e63fb1db8b8 tempest-VolumesActionsTest-65974355 None] Lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Created reservations ['d761929f-96d4-4a99-9ea8-ab8ce1a27a28', '9fe4d11a-c5ea-4d3c-9429-ed09373a22eb', 'bf86ffaf-6767-426c-9f7c-cb018be328e9', '94953114-f8f1-4bf8-b19e-2d8c740d2da5'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:46 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:41:46 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-72579e9a-cc5d-4eb7-96f8-c31d5c468a24 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd-detach_volume" by "detach_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-72579e9a-cc5d-4eb7-96f8-c31d5c468a24 tempest-VolumesActionsTest-1268879803 None] Lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd-detach_volume" acquired by "detach_volume" :: waited 0.080s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-72579e9a-cc5d-4eb7-96f8-c31d5c468a24 tempest-VolumesActionsTest-1268879803 None] Volume detach called, but volume not attached. Sep 05 04:41:46 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.578s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:41:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a1844c09-ed3d-45a6-8c61-9c8d367e1bd9 tempest-GroupsTest-810610500 None] Delete group completed successfully. Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-72579e9a-cc5d-4eb7-96f8-c31d5c468a24 tempest-VolumesActionsTest-1268879803 None] Lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Creating offline snapshot 9b7c71dc-4bae-46a9-979d-1555bd666460 of volume d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-5f8883aa-5394-4bcb-ae1c-f131816fff07 tempest-GroupsTest-810610500 None] Created reservations ['174355d0-e4df-4869-979a-381a53c37a6a'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee61e5-32bf-472e-b364-8edc83e5031c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5f8883aa-5394-4bcb-ae1c-f131816fff07 tempest-GroupsTest-810610500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5f8883aa-5394-4bcb-ae1c-f131816fff07 tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5f8883aa-5394-4bcb-ae1c-f131816fff07 tempest-GroupsTest-810610500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5f8883aa-5394-4bcb-ae1c-f131816fff07 tempest-GroupsTest-810610500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5f8883aa-5394-4bcb-ae1c-f131816fff07 tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5f8883aa-5394-4bcb-ae1c-f131816fff07 tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:47 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:41:47 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:47 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a Sep 05 04:41:47 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Acquiring lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Acquiring lock "cinder-quobyte-e486d32c-62a3-4bcb-96b1-d79deb5be6dd" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Lock "cinder-quobyte-e486d32c-62a3-4bcb-96b1-d79deb5be6dd" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[45abb100-2088-47d7-8ae8-a5edcdbebff9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:47 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" returned: 0 in 0.479s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:47 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5f8883aa-5394-4bcb-ae1c-f131816fff07 tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.419s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-5f8883aa-5394-4bcb-ae1c-f131816fff07 tempest-GroupsTest-810610500 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:41:47 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 1G Sep 05 04:41:47 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5f8883aa-5394-4bcb-ae1c-f131816fff07 tempest-GroupsTest-810610500 None] Delete group completed successfully. Sep 05 04:41:47 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:47 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd Sep 05 04:41:47 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:47 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd" returned: 0 in 0.378s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:47 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd Sep 05 04:41:47 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:47 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 1G" returned: 0 in 0.477s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:48 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 Sep 05 04:41:48 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:48 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e486d32c-62a3-4bcb-96b1-d79deb5be6dd" returned: 0 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Lock "cinder-quobyte-e486d32c-62a3-4bcb-96b1-d79deb5be6dd" released by "delete_volume" :: held 0.824s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Created reservations ['e789a01f-f466-46b5-ae69-2beca492907d', 'c2aa1e16-4aa9-4427-b8d3-5dc2ca15ea59', 'a87d7e6d-75fa-4f27-a0a1-72c0e54c46da', 'ed7c747e-65fd-496b-89dd-07e12fdb6925'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:48 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460" returned: 0 in 0.446s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:48 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 is being set with open permissions: ugo+rw Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:48 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:41:48 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:48 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 Sep 05 04:41:48 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:48 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:41:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Deleted volume successfully. Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bc1a856c-947e-4a0d-becb-2fc98da96c0d tempest-VolumesActionsTest-1268879803 None] Lock "cinder-e486d32c-62a3-4bcb-96b1-d79deb5be6dd-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:48 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460" returned: 0 in 0.501s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9b37750d-e10b-4e69-832c-b2f403460ea9 tempest-GroupsTest-810610500 None] Group tempest-GroupsTest-Group-170316546: creating Sep 05 04:41:49 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9b37750d-e10b-4e69-832c-b2f403460ea9 tempest-GroupsTest-810610500 None] Group tempest-GroupsTest-Group-170316546: created successfully Sep 05 04:41:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:49 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9b37750d-e10b-4e69-832c-b2f403460ea9 tempest-GroupsTest-810610500 None] Create group completed successfully. Sep 05 04:41:49 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.info Sep 05 04:41:49 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:49 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.info" returned: 0 in 0.324s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:49 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.info is being set with open permissions: ugo+rw Sep 05 04:41:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:49 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.info Sep 05 04:41:49 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:49 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.info" returned: 0 in 0.315s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:49 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-74d2594b-dcde-4fc5-b211-5d6e5767f928 tempest-VolumesDeleteCascade-270594991 None] Create snapshot completed successfully Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] Creating offline snapshot 30a8c761-5bce-4e6a-aa70-8a950bee6984 of volume d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4c93f9-063a-4680-9b7c-ee704220507c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:50 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 Sep 05 04:41:50 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Flow 'volume_create_manager' (c9710f93-98de-4972-bdd9-806af4473a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f5cfcf-1ecc-4556-8f16-746fe0c2f614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f5cfcf-1ecc-4556-8f16-746fe0c2f614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1570449781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=26718ddf-64b7-4ae3-a086-b37fb060e109,host='devstack@QuobyteHD#QuobyteHD',id=9564100a-2400-4994-ba91-7a7778d035a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae89a6b678145298eaa87b277bc969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:51Z,use_quota=True,user_id='57311191f0bf4d039187ec086afb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3444ae2c-2d70-4600-a269-3d320b9e6c79),volume_type_id=3444ae2c-2d70-4600-a269-3d320b9e6c79)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a462b647-2a99-48bc-a5cd-586f2159ae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a462b647-2a99-48bc-a5cd-586f2159ae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da6a9c1-37e2-4d38-9cdb-3fe98a6a0cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da6a9c1-37e2-4d38-9cdb-3fe98a6a0cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9564100a-2400-4994-ba91-7a7778d035a3', 'volume_name': 'volume-9564100a-2400-4994-ba91-7a7778d035a3', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7147f05e-5fc7-4433-9a03-9aec4a6d9741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7147f05e-5fc7-4433-9a03-9aec4a6d9741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a5e4e8-ec94-48ca-823f-b540ea0de755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:50 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Volume 9564100a-2400-4994-ba91-7a7778d035a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9564100a-2400-4994-ba91-7a7778d035a3', 'volume_size': 1} Sep 05 04:41:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:51 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460" returned: 0 in 0.473s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:51 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 1G Sep 05 04:41:51 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:51 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 1G" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:51 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 Sep 05 04:41:51 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:51 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984" returned: 0 in 0.274s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:51 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 is being set with open permissions: ugo+rw Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:51 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 Sep 05 04:41:51 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:51 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984" returned: 0 in 0.238s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=127,cinder:SELECT=110,cinder:INSERT=35,cinder:DELETE=7 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.518s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.116s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=26718ddf-64b7-4ae3-a086-b37fb060e109,created_at=2026-09-05T02:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1570449781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=26718ddf-64b7-4ae3-a086-b37fb060e109,host='devstack@QuobyteHD#QuobyteHD',id=9564100a-2400-4994-ba91-7a7778d035a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae89a6b678145298eaa87b277bc969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:51Z,use_quota=True,user_id='57311191f0bf4d039187ec086afb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3444ae2c-2d70-4600-a269-3d320b9e6c79),volume_type_id=3444ae2c-2d70-4600-a269-3d320b9e6c79)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Creating volume 9564100a-2400-4994-ba91-7a7778d035a3 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:51 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:52 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3 1073741824 Sep 05 04:41:52 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-af611258-2c96-47f3-92bc-fe8814ce36db tempest-VolumesDeleteCascade-270594991 None] Create snapshot completed successfully Sep 05 04:41:52 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3 1073741824" returned: 0 in 0.420s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:52 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3 Sep 05 04:41:52 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (61753b6a-ef6b-4658-a195-02885dd27372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2aab98-dbb3-470a-8c07-ec49003703ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2aab98-dbb3-470a-8c07-ec49003703ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1103579265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5820fbd-3714-4f70-adc4-d9820652924a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:53Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb4c501-b499-4ca6-a255-01c475c2c5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb4c501-b499-4ca6-a255-01c475c2c5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2a57ab-6c76-4a0a-b4cf-1ec8c0acbaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2a57ab-6c76-4a0a-b4cf-1ec8c0acbaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5820fbd-3714-4f70-adc4-d9820652924a', 'volume_name': 'volume-c5820fbd-3714-4f70-adc4-d9820652924a', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b284d1-4d41-44e3-ae69-da8f13a31446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b284d1-4d41-44e3-ae69-da8f13a31446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e3a9ff-15e9-4fa7-a6ea-359c9bc580a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:52 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Volume c5820fbd-3714-4f70-adc4-d9820652924a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5820fbd-3714-4f70-adc4-d9820652924a', 'volume_size': 1} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Performing cascade delete. {{(pid=89807) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-30a8c761-5bce-4e6a-aa70-8a950bee6984-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:52 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3" returned: 0 in 0.298s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-30a8c761-5bce-4e6a-aa70-8a950bee6984-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1103579265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5820fbd-3714-4f70-adc4-d9820652924a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:53Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Creating volume c5820fbd-3714-4f70-adc4-d9820652924a {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:52 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:52 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a 1073741824 Sep 05 04:41:52 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a5e4e8-ec94-48ca-823f-b540ea0de755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9564100a-2400-4994-ba91-7a7778d035a3', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3594ac33-deb1-41cf-98c9-e6a69bccbc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:52 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Volume volume-9564100a-2400-4994-ba91-7a7778d035a3 (9564100a-2400-4994-ba91-7a7778d035a3): created successfully Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3594ac33-deb1-41cf-98c9-e6a69bccbc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Flow 'volume_create_manager' (c9710f93-98de-4972-bdd9-806af4473a29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-30a8c761-5bce-4e6a-aa70-8a950bee6984" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9acee1f5-07a7-4a58-bf1d-64051ffe2bbc tempest-GroupsTest-810610500 None] Created volume successfully. Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-30a8c761-5bce-4e6a-aa70-8a950bee6984" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Deleting offline snapshot 30a8c761-5bce-4e6a-aa70-8a950bee6984 of volume d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] snapshot_file for this snap is: volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb28720-0632-47eb-8c72-a1fb2132a784]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:53 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 Sep 05 04:41:53 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:53 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a 1073741824" returned: 0 in 0.571s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:53 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984" returned: 0 in 0.457s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[442cda28-e2cd-49fc-ba47-b908b0702195]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:53 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a Sep 05 04:41:53 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:53 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 Sep 05 04:41:53 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:53 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a" returned: 0 in 0.403s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e3a9ff-15e9-4fa7-a6ea-359c9bc580a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5820fbd-3714-4f70-adc4-d9820652924a', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f545107-f53f-4b4d-997f-4ccdb8d2bc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:53 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Volume volume-c5820fbd-3714-4f70-adc4-d9820652924a (c5820fbd-3714-4f70-adc4-d9820652924a): created successfully Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f545107-f53f-4b4d-997f-4ccdb8d2bc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:53 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (61753b6a-ef6b-4658-a195-02885dd27372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460" returned: 0 in 0.512s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:41:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7c03dad9-1ca8-44e5-b26f-08667ac4ea11 tempest-VolumesActionsTest-1268879803 None] Created volume successfully. Sep 05 04:41:53 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 Sep 05 04:41:53 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Flow 'volume_create_manager' (9f048759-b107-40d5-a4a8-5b7495472088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5b0259-9214-466c-b35c-8e263d0f8f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5b0259-9214-466c-b35c-8e263d0f8f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289122271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=26718ddf-64b7-4ae3-a086-b37fb060e109,host='devstack@QuobyteHD#QuobyteHD',id=69d553f4-7019-48a8-9a8b-9a96da7f9161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae89a6b678145298eaa87b277bc969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:54Z,use_quota=True,user_id='57311191f0bf4d039187ec086afb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3444ae2c-2d70-4600-a269-3d320b9e6c79),volume_type_id=3444ae2c-2d70-4600-a269-3d320b9e6c79)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ee9019-ba41-4b14-acf4-3feada2904cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ee9019-ba41-4b14-acf4-3feada2904cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bda5be-d1c9-4392-a084-337c20885e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bda5be-d1c9-4392-a084-337c20885e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d553f4-7019-48a8-9a8b-9a96da7f9161', 'volume_name': 'volume-69d553f4-7019-48a8-9a8b-9a96da7f9161', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52ae83b-e403-4255-89dd-1eefb1b44c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52ae83b-e403-4255-89dd-1eefb1b44c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ae0996-82ea-4097-9d15-0ed05a110246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:54 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Volume 69d553f4-7019-48a8-9a8b-9a96da7f9161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d553f4-7019-48a8-9a8b-9a96da7f9161', 'volume_size': 1} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=26718ddf-64b7-4ae3-a086-b37fb060e109,created_at=2026-09-05T02:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289122271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=26718ddf-64b7-4ae3-a086-b37fb060e109,host='devstack@QuobyteHD#QuobyteHD',id=69d553f4-7019-48a8-9a8b-9a96da7f9161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae89a6b678145298eaa87b277bc969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:54Z,use_quota=True,user_id='57311191f0bf4d039187ec086afb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3444ae2c-2d70-4600-a269-3d320b9e6c79),volume_type_id=3444ae2c-2d70-4600-a269-3d320b9e6c79)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Creating volume 69d553f4-7019-48a8-9a8b-9a96da7f9161 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:54 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:54 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161 1073741824 Sep 05 04:41:54 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:54 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984" returned: 0 in 0.413s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:54 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984 Sep 05 04:41:54 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:54 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:54 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161 1073741824" returned: 0 in 0.429s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.30a8c761-5bce-4e6a-aa70-8a950bee6984" returned: 0 in 0.291s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-30a8c761-5bce-4e6a-aa70-8a950bee6984" released by "_delete_snapshot" :: held 1.801s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" released by "delete_snapshot" :: held 1.852s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:54 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161 Sep 05 04:41:54 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Created reservations ['725d7e63-dc18-4673-8950-3f1e1ba6d4db', '1a2bc348-c0e1-4104-a85f-9fb66073dda7', 'bbded21e-5695-42e7-9386-6dab7a4a4747', 'faf13b09-50a3-4270-a9a1-a6d3dafd4376'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:54 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Delete snapshot completed successfully. Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-30a8c761-5bce-4e6a-aa70-8a950bee6984-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:54 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-9b7c71dc-4bae-46a9-979d-1555bd666460-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-9b7c71dc-4bae-46a9-979d-1555bd666460-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Acquiring lock "cinder-c5820fbd-3714-4f70-adc4-d9820652924a-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Lock "cinder-c5820fbd-3714-4f70-adc4-d9820652924a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-9b7c71dc-4bae-46a9-979d-1555bd666460" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-9b7c71dc-4bae-46a9-979d-1555bd666460" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Deleting offline snapshot 9b7c71dc-4bae-46a9-979d-1555bd666460 of volume d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] snapshot_file for this snap is: volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:41:55 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161" returned: 0 in 0.476s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a7c51d-5f5d-4974-bb36-1cbed5c486af]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Acquiring lock "cinder-quobyte-c5820fbd-3714-4f70-adc4-d9820652924a" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ae0996-82ea-4097-9d15-0ed05a110246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d553f4-7019-48a8-9a8b-9a96da7f9161', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08394849-7d96-4c39-b6a9-85932157b1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Lock "cinder-quobyte-c5820fbd-3714-4f70-adc4-d9820652924a" acquired by "delete_volume" :: waited 0.038s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:55 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Volume volume-69d553f4-7019-48a8-9a8b-9a96da7f9161 (69d553f4-7019-48a8-9a8b-9a96da7f9161): created successfully Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08394849-7d96-4c39-b6a9-85932157b1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Flow 'volume_create_manager' (9f048759-b107-40d5-a4a8-5b7495472088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:55 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-cf6062d8-b38f-46ea-9163-4ef1896df793 tempest-GroupsTest-810610500 None] Created volume successfully. Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fced2fc-d39e-4d1f-a22c-cc10be118efb]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:55 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 Sep 05 04:41:55 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:55 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a Sep 05 04:41:55 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:55 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460" returned: 0 in 0.441s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a497061-f660-4ff4-884b-d5da5c288ec3]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:55 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a" returned: 0 in 0.421s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:55 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a Sep 05 04:41:55 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:55 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a Sep 05 04:41:55 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:56 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c5820fbd-3714-4f70-adc4-d9820652924a" returned: 0 in 0.278s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Lock "cinder-quobyte-c5820fbd-3714-4f70-adc4-d9820652924a" released by "delete_volume" :: held 0.782s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:56 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:56 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 Sep 05 04:41:56 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Created reservations ['1518c1d9-b2c6-4a1f-9cab-924bffb953dd', 'e9953017-523b-4edc-9f31-5ccf966466d7', '7b21d0b5-9b06-4eb7-9081-33196bcda083', 'f4ec5c5a-7801-4b80-bd3a-d590055f60f8'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:56 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:41:56 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:56 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.317s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:41:56 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:56 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Deleted volume successfully. Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460" returned: 0 in 0.467s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:56 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460 Sep 05 04:41:56 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef494f1c-afb8-4601-a5be-93ad2a1d6823 tempest-VolumesActionsTest-65974355 None] Lock "cinder-c5820fbd-3714-4f70-adc4-d9820652924a-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:56 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-23d84381-e50d-405a-bdf4-59e0d7026abf tempest-GroupsTest-810610500 None] Update group completed successfully. Sep 05 04:41:56 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a.9b7c71dc-4bae-46a9-979d-1555bd666460" returned: 0 in 0.296s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-9b7c71dc-4bae-46a9-979d-1555bd666460" released by "_delete_snapshot" :: held 1.746s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" released by "delete_snapshot" :: held 1.786s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (475f64b9-04ef-43f2-b728-87a68836f879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddbaa9c-da32-4f5d-968f-918a1d7f5abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddbaa9c-da32-4f5d-968f-918a1d7f5abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-796408439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2744b9bc-17ac-46a1-84c3-9a7b9749145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:57Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954694fc-b34c-4885-8132-9c13003c1b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954694fc-b34c-4885-8132-9c13003c1b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a8b44a-a533-4e76-8825-0763c5110ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a8b44a-a533-4e76-8825-0763c5110ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2744b9bc-17ac-46a1-84c3-9a7b9749145c', 'volume_name': 'volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b844d0dc-6a93-4eac-89cc-efd7ef818641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b844d0dc-6a93-4eac-89cc-efd7ef818641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e1ad7f-4b73-49e1-b0b5-5c20bc7989bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:56 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Volume 2744b9bc-17ac-46a1-84c3-9a7b9749145c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c', 'volume_size': 1} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-796408439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2744b9bc-17ac-46a1-84c3-9a7b9749145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:57Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Creating volume 2744b9bc-17ac-46a1-84c3-9a7b9749145c {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:57 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:57 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c 1073741824 Sep 05 04:41:57 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Created reservations ['e37ae2f6-59d3-46e2-9cbe-fdae44140ca2', '9ebc4c92-52f5-4831-96a8-38642cdc6c73', '05567ab2-fe9f-4916-8bec-35ddfd568330', 'ca6a17d0-2e7b-47e3-950f-dd36e70e20af'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Delete snapshot completed successfully. Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-9b7c71dc-4bae-46a9-979d-1555bd666460-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Snapshots deleted, issuing volume delete {{(pid=89807) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a6880b-2e36-4cfa-b5f6-35088ccdb015]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:57 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a Sep 05 04:41:57 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:57 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c 1073741824" returned: 0 in 0.544s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:57 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c Sep 05 04:41:57 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:57 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" returned: 0 in 0.432s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-ed2b05d7-81a6-4bde-a78a-55ffb0862b48 req-1f85af50-0c73-4e2b-bbb9-3543fa816be8 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:57 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a Sep 05 04:41:57 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:57 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c" returned: 0 in 0.265s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-ed2b05d7-81a6-4bde-a78a-55ffb0862b48 req-1f85af50-0c73-4e2b-bbb9-3543fa816be8 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.200s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e1ad7f-4b73-49e1-b0b5-5c20bc7989bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20297c07-2ee7-4237-89a5-ae1e4b6def29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-ed2b05d7-81a6-4bde-a78a-55ffb0862b48 req-1f85af50-0c73-4e2b-bbb9-3543fa816be8 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:57 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Volume volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c (2744b9bc-17ac-46a1-84c3-9a7b9749145c): created successfully Sep 05 04:41:57 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20297c07-2ee7-4237-89a5-ae1e4b6def29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (475f64b9-04ef-43f2-b728-87a68836f879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" returned: 0 in 0.279s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a" released by "delete_volume" :: held 0.788s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-706b73c6-a91b-4f25-b08a-098b7a63341e tempest-VolumesActionsTest-1268879803 None] Created volume successfully. Sep 05 04:41:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-ed2b05d7-81a6-4bde-a78a-55ffb0862b48 req-1f85af50-0c73-4e2b-bbb9-3543fa816be8 tempest-ServerActionsTestOtherA-289008059 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76a08939-ba4b-478a-ae0e-74b87929b8e5', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:41:58 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Created reservations ['b31e74cf-1d13-429d-8edd-c649c6d11fe4', '4d906ce2-12a7-47ef-b832-20f86d1d6ee2', '9d86f692-a3cc-408a-9400-b2095ba08a40', '73214a2d-c8d0-4a61-84a9-678c1acce5f0'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:41:58 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-ed2b05d7-81a6-4bde-a78a-55ffb0862b48 req-1f85af50-0c73-4e2b-bbb9-3543fa816be8 tempest-ServerActionsTestOtherA-289008059 None] attachment_update completed successfully. Sep 05 04:41:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:58 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:41:58 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:58 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8677a08f-fc6f-4c28-8a82-a2fd0fa68020 tempest-GroupsTest-810610500 None] Update group completed successfully. Sep 05 04:41:58 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.312s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:58 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:41:58 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Deleted volume successfully. Sep 05 04:41:58 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9bb443f1-1f02-443a-aa95-1074a683e8a4 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-d1d3c33d-d4bf-4ad0-b00c-d964d50c2d9a-delete_volume" released by "delete_volume" :: held 5.811s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Flow 'volume_create_manager' (f47b878c-6003-46c4-bdb8-64822f378e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beebe3f9-d626-4558-b280-7aaf888d2b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beebe3f9-d626-4558-b280-7aaf888d2b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-334018095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2f39ee-2a02-4f54-ad91-c965d2d7173c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c36b85dcb34a068032103b5c382d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:59Z,use_quota=True,user_id='ebb57db8e2aa4294bc35db482ff25e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5db76a8-9f6d-4fc0-8d6a-eeb9c3b97130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5db76a8-9f6d-4fc0-8d6a-eeb9c3b97130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a3f5cc-071a-48ca-af06-9d8285258ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a3f5cc-071a-48ca-af06-9d8285258ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2f39ee-2a02-4f54-ad91-c965d2d7173c', 'volume_name': 'volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55ebbc0-aef9-4843-a291-0fee0eb68692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55ebbc0-aef9-4843-a291-0fee0eb68692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77389025-30cc-4ae3-a97c-d4151e782f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:41:59 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Volume 8a2f39ee-2a02-4f54-ad91-c965d2d7173c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c', 'volume_size': 1} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-334018095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2f39ee-2a02-4f54-ad91-c965d2d7173c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c36b85dcb34a068032103b5c382d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:41:59Z,use_quota=True,user_id='ebb57db8e2aa4294bc35db482ff25e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Creating volume 8a2f39ee-2a02-4f54-ad91-c965d2d7173c {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:41:59 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:59 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c 1073741824 Sep 05 04:41:59 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Acquiring lock "cinder-2744b9bc-17ac-46a1-84c3-9a7b9749145c-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Lock "cinder-2744b9bc-17ac-46a1-84c3-9a7b9749145c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Acquiring lock "cinder-quobyte-2744b9bc-17ac-46a1-84c3-9a7b9749145c" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Lock "cinder-quobyte-2744b9bc-17ac-46a1-84c3-9a7b9749145c" acquired by "delete_volume" :: waited 0.039s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8994985a-4a5a-4315-a90a-1b99456cef37]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:59 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c Sep 05 04:41:59 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:59 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c 1073741824" returned: 0 in 0.519s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:59 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c Sep 05 04:41:59 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:41:59 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c" returned: 0 in 0.432s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:41:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:41:59 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c Sep 05 04:41:59 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:00 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Acquiring lock "cinder-quobyte-69d553f4-7019-48a8-9a8b-9a96da7f9161" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" returned: 0 in 0.341s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Lock "cinder-quobyte-69d553f4-7019-48a8-9a8b-9a96da7f9161" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77389025-30cc-4ae3-a97c-d4151e782f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa080b74-881c-4596-bdef-520fc68b05ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b299cc-7e9c-4e42-ad9d-b9b6dd7805e6]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:00 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:00 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Volume volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c (8a2f39ee-2a02-4f54-ad91-c965d2d7173c): created successfully Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa080b74-881c-4596-bdef-520fc68b05ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Flow 'volume_create_manager' (f47b878c-6003-46c4-bdb8-64822f378e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2744b9bc-17ac-46a1-84c3-9a7b9749145c" returned: 0 in 0.381s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Lock "cinder-quobyte-2744b9bc-17ac-46a1-84c3-9a7b9749145c" released by "delete_volume" :: held 0.874s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:00 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9039e5b0-6499-4f0f-a3c9-990465255ef8 tempest-VolumesDeleteCascade-270594991 None] Created volume successfully. Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Created reservations ['c1053776-1a99-40f5-b3ff-eda57e430c76', '90794896-cbda-4cb2-b3ac-75e07b87d5f9', '379b96ff-a7bd-4b2b-ab25-24ec8e6e305a', '7e1f21f5-40ed-4392-986e-1b2546d89788'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:00 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161 Sep 05 04:42:00 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:00 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:00 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:00 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161" returned: 0 in 0.428s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:00 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161 Sep 05 04:42:00 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:00 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.308s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:00 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Deleted volume successfully. Sep 05 04:42:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba8bb38-4b3d-4b23-b985-a4ddd193fc29 tempest-VolumesActionsTest-65974355 None] Lock "cinder-2744b9bc-17ac-46a1-84c3-9a7b9749145c-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:01 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-69d553f4-7019-48a8-9a8b-9a96da7f9161" returned: 0 in 0.419s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Lock "cinder-quobyte-69d553f4-7019-48a8-9a8b-9a96da7f9161" released by "delete_volume" :: held 0.922s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Acquiring lock "cinder-quobyte-9564100a-2400-4994-ba91-7a7778d035a3" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Lock "cinder-quobyte-9564100a-2400-4994-ba91-7a7778d035a3" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68770a7-7e25-445a-81e3-66e8fb02acdb]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:01 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3 Sep 05 04:42:01 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (7a9b0003-2ebf-46cc-838d-91b2b1139936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f95a45-db1a-4b92-96a8-fdd9e77b272b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f95a45-db1a-4b92-96a8-fdd9e77b272b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1127401184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d5d954-1f07-44bb-a6a9-422171d59824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:01Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75814b5-24c1-4215-b09e-dd431ae26068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75814b5-24c1-4215-b09e-dd431ae26068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7248fd9-54ea-4e60-b5f7-4f897ccbc8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7248fd9-54ea-4e60-b5f7-4f897ccbc8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5d5d954-1f07-44bb-a6a9-422171d59824', 'volume_name': 'volume-b5d5d954-1f07-44bb-a6a9-422171d59824', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b386984d-c989-43b6-82ec-99958e97c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b386984d-c989-43b6-82ec-99958e97c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58df25c-3131-4407-b298-6db3462cdae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:01 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Volume b5d5d954-1f07-44bb-a6a9-422171d59824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5d5d954-1f07-44bb-a6a9-422171d59824', 'volume_size': 1} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1127401184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d5d954-1f07-44bb-a6a9-422171d59824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:01Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Creating volume b5d5d954-1f07-44bb-a6a9-422171d59824 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:01 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:01 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824 1073741824 Sep 05 04:42:01 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:01 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3" returned: 0 in 0.432s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:01 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3 Sep 05 04:42:01 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:01 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-5c3862ba-05e5-4a11-babf-94749a73d668 req-465e1a4f-41db-4ceb-8bff-154d4c962a7c tempest-ServerActionsTestOtherA-289008059 None] Terminate volume connection completed successfully. Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-5c3862ba-05e5-4a11-babf-94749a73d668 req-465e1a4f-41db-4ceb-8bff-154d4c962a7c tempest-ServerActionsTestOtherA-289008059 None] Deleting attachment 76a08939-ba4b-478a-ae0e-74b87929b8e5. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:42:01 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9564100a-2400-4994-ba91-7a7778d035a3" returned: 0 in 0.320s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Lock "cinder-quobyte-9564100a-2400-4994-ba91-7a7778d035a3" released by "delete_volume" :: held 0.833s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:01 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824 1073741824" returned: 0 in 0.527s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Created reservations ['1764d2f1-2146-4f56-9982-298590f8b663'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:02 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824 Sep 05 04:42:02 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:02 devstack cinder-volume[89807]: WARNING cinder.quota [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-904465919 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-904465919, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:42:02 devstack cinder-volume[89807]: WARNING cinder.quota [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-904465919 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-904465919, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Created reservations ['07e98049-ffd8-4d80-9baa-5e9c52183c66', '55489086-43ce-4151-9530-ec5766300c8b', '44eb6fff-6c70-47f0-82f0-92e48c900431', '8724a416-f9ab-47c6-b939-bb45d0a23c12'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:02 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824" returned: 0 in 0.465s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.990s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Created reservations ['136ecaf7-fe90-4d5e-8fee-bb9961e4711a', 'd97b05a8-d190-41d7-8892-2b97f7b926bc', 'a3074688-f275-4e86-9837-3383e84c721f', '87b56513-2a05-4d66-b554-b582f3f52e55'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58df25c-3131-4407-b298-6db3462cdae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5d5d954-1f07-44bb-a6a9-422171d59824', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258ede47-eca7-444a-9de5-99c83c6f276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Creating offline snapshot 7671165e-8721-4948-a06c-862f15147ec9 of volume 8a2f39ee-2a02-4f54-ad91-c965d2d7173c {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:42:02 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Volume volume-b5d5d954-1f07-44bb-a6a9-422171d59824 (b5d5d954-1f07-44bb-a6a9-422171d59824): created successfully Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258ede47-eca7-444a-9de5-99c83c6f276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (7a9b0003-2ebf-46cc-838d-91b2b1139936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9ec15-d049-4b71-83ad-742ec2aefc38]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:02 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-61eb760c-aee8-43f8-aae4-a047edb054c4 tempest-VolumesActionsTest-1268879803 None] Created volume successfully. Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:02 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c Sep 05 04:42:02 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:02 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:02 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-5c3862ba-05e5-4a11-babf-94749a73d668 req-cc4a8fae-3401-48fe-afaf-641577758ba8 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:03 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.301s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:03 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6c69fab5-3a0b-4dab-8921-220d37dda631 tempest-GroupsTest-810610500 None] Delete group completed successfully. Sep 05 04:42:03 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" returned: 0 in 0.532s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:03 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 1G Sep 05 04:42:03 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Acquiring lock "cinder-b5d5d954-1f07-44bb-a6a9-422171d59824-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Lock "cinder-b5d5d954-1f07-44bb-a6a9-422171d59824-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Acquiring lock "cinder-quobyte-b5d5d954-1f07-44bb-a6a9-422171d59824" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Lock "cinder-quobyte-b5d5d954-1f07-44bb-a6a9-422171d59824" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fe806a-17ee-4683-90de-8ddaa1c7d1dc]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:03 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 1G" returned: 0 in 0.454s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:03 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 Sep 05 04:42:03 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:03 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824 Sep 05 04:42:03 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:03 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824" returned: 0 in 0.394s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:03 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9" returned: 0 in 0.350s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:03 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 is being set with open permissions: ugo+rw Sep 05 04:42:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:03 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824 Sep 05 04:42:03 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:03 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 Sep 05 04:42:03 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:04 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:04 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9" returned: 0 in 0.304s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b5d5d954-1f07-44bb-a6a9-422171d59824" returned: 0 in 0.333s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Lock "cinder-quobyte-b5d5d954-1f07-44bb-a6a9-422171d59824" released by "delete_volume" :: held 0.783s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:04 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.info Sep 05 04:42:04 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Created reservations ['d1b1363f-cd13-4429-a450-beda5657c282', '88fc2254-9823-4320-a49e-c701a4b2fba2', '44d55fd0-60e3-4d8f-b570-943b6349e52d', 'b27a813f-8d86-4128-96a6-cd01cd9011be'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:04 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:04 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:04 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.info" returned: 0 in 0.312s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:04 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.info is being set with open permissions: ugo+rw Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:04 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.info Sep 05 04:42:04 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:04 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.312s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:04 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Deleted volume successfully. Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7db14f93-49da-4f95-8d0f-faaf060a7c1a tempest-VolumesActionsTest-65974355 None] Lock "cinder-b5d5d954-1f07-44bb-a6a9-422171d59824-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:04 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.info" returned: 0 in 0.338s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-5c3862ba-05e5-4a11-babf-94749a73d668 req-cc4a8fae-3401-48fe-afaf-641577758ba8 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.095s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-5c3862ba-05e5-4a11-babf-94749a73d668 req-cc4a8fae-3401-48fe-afaf-641577758ba8 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4fdad555-f048-484f-9f51-032583e972d4 tempest-VolumesDeleteCascade-270594991 None] Create snapshot completed successfully Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-5c3862ba-05e5-4a11-babf-94749a73d668 req-cc4a8fae-3401-48fe-afaf-641577758ba8 tempest-ServerActionsTestOtherA-289008059 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '866a5a8d-857d-4b24-af23-367730dd9069', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:42:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-5c3862ba-05e5-4a11-babf-94749a73d668 req-cc4a8fae-3401-48fe-afaf-641577758ba8 tempest-ServerActionsTestOtherA-289008059 None] attachment_update completed successfully. Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (09fbdeae-9f30-414a-8506-142658e61def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594af482-b873-4a8a-93d4-23df529c044a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594af482-b873-4a8a-93d4-23df529c044a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1432543694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1179a3e0-6e65-4645-b089-332c41f5d5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:05Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb24ea4-8175-40a2-a71e-a7afedadb144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb24ea4-8175-40a2-a71e-a7afedadb144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcb51eb-760e-4396-9165-ed1b876ffc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcb51eb-760e-4396-9165-ed1b876ffc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1179a3e0-6e65-4645-b089-332c41f5d5a8', 'volume_name': 'volume-1179a3e0-6e65-4645-b089-332c41f5d5a8', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb6d397-9635-4265-9177-9bec94f4983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb6d397-9635-4265-9177-9bec94f4983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1aef35-88b4-4cfe-8bc2-a80be551ca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:05 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Volume 1179a3e0-6e65-4645-b089-332c41f5d5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1179a3e0-6e65-4645-b089-332c41f5d5a8', 'volume_size': 1} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1432543694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1179a3e0-6e65-4645-b089-332c41f5d5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:05Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Creating volume 1179a3e0-6e65-4645-b089-332c41f5d5a8 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:05 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:42:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:05 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8 1073741824 Sep 05 04:42:05 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:06 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8 1073741824" returned: 0 in 0.623s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:06 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8 Sep 05 04:42:06 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:06 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Flow 'volume_create_manager' (714246d8-c5d4-433c-ad53-e84f5b484e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaba65bb-1599-4ba5-9c33-cc303a0eb74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8" returned: 0 in 0.348s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaba65bb-1599-4ba5-9c33-cc303a0eb74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2032461816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70daf78-a08a-4ec8-949d-d978743b283a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c36b85dcb34a068032103b5c382d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7671165e-8721-4948-a06c-862f15147ec9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:06Z,use_quota=True,user_id='ebb57db8e2aa4294bc35db482ff25e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd60ba2-38ba-4b35-b938-3af03e54b8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd60ba2-38ba-4b35-b938-3af03e54b8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cf66bf-c98e-44fe-b98b-c74dcd76f5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cf66bf-c98e-44fe-b98b-c74dcd76f5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f70daf78-a08a-4ec8-949d-d978743b283a', 'volume_name': 'volume-f70daf78-a08a-4ec8-949d-d978743b283a', 'volume_size': 1, 'snapshot_id': '7671165e-8721-4948-a06c-862f15147ec9'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1357c51f-ae3b-439f-9c26-b82dbfe46d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1357c51f-ae3b-439f-9c26-b82dbfe46d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b6b6c5-3052-45fa-9027-8ecdfbdd2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:06 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Volume f70daf78-a08a-4ec8-949d-d978743b283a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f70daf78-a08a-4ec8-949d-d978743b283a', 'volume_size': 1, 'snapshot_id': '7671165e-8721-4948-a06c-862f15147ec9'} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1aef35-88b4-4cfe-8bc2-a80be551ca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1179a3e0-6e65-4645-b089-332c41f5d5a8', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea96336c-213e-4ef3-aa67-ecc65bf8f652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-7671165e-8721-4948-a06c-862f15147ec9-f70daf78-a08a-4ec8-949d-d978743b283a" by "_create_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:06 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Volume volume-1179a3e0-6e65-4645-b089-332c41f5d5a8 (1179a3e0-6e65-4645-b089-332c41f5d5a8): created successfully Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea96336c-213e-4ef3-aa67-ecc65bf8f652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (09fbdeae-9f30-414a-8506-142658e61def) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-7671165e-8721-4948-a06c-862f15147ec9-f70daf78-a08a-4ec8-949d-d978743b283a" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Creating volume f70daf78-a08a-4ec8-949d-d978743b283a from snapshot 7671165e-8721-4948-a06c-862f15147ec9 {{(pid=89807) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-f70daf78-a08a-4ec8-949d-d978743b283a" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-26d63ef1-2299-4558-86fe-ddf6534db7e0 tempest-VolumesActionsTest-1268879803 None] Created volume successfully. Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-f70daf78-a08a-4ec8-949d-d978743b283a" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] snapshot: 7671165e-8721-4948-a06c-862f15147ec9, volume: f70daf78-a08a-4ec8-949d-d978743b283a, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[7427bd47-b506-4460-b499-b68e1131891b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:06 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 Sep 05 04:42:06 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:07 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9" returned: 0 in 0.634s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eec8ef-bfbf-47d9-980b-241a74d91f65]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:07 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c Sep 05 04:42:07 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Acquiring lock "cinder-1179a3e0-6e65-4645-b089-332c41f5d5a8-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Lock "cinder-1179a3e0-6e65-4645-b089-332c41f5d5a8-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Acquiring lock "cinder-quobyte-1179a3e0-6e65-4645-b089-332c41f5d5a8" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:07 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" returned: 0 in 0.520s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Lock "cinder-quobyte-1179a3e0-6e65-4645-b089-332c41f5d5a8" acquired by "delete_volume" :: waited 0.057s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:07 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a Sep 05 04:42:07 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dfa7b2-cf78-4b9c-8cfd-11fbd33bed39]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:08 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8 Sep 05 04:42:08 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:08 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8" returned: 0 in 0.745s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:08 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8 Sep 05 04:42:08 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:09 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1179a3e0-6e65-4645-b089-332c41f5d5a8" returned: 0 in 0.902s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Lock "cinder-quobyte-1179a3e0-6e65-4645-b089-332c41f5d5a8" released by "delete_volume" :: held 1.758s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:09 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Created reservations ['61fe5a80-86c1-4461-865d-a9ab9fcbcfe1', '98c6de3d-0726-45ec-adaf-b3b7a037b5e7', 'd77f9826-b594-47c9-a6d0-9fad23a43fbb', '11740ebe-f2a9-4522-850e-24df687278a7'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:10 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:10 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:10 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:10 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:11 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:11 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.701s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 1.032s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:42:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 28 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:42:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:42:11 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Deleted volume successfully. Sep 05 04:42:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db3e1567-e29d-4189-9849-03387d3b650e tempest-VolumesActionsTest-65974355 None] Lock "cinder-1179a3e0-6e65-4645-b089-332c41f5d5a8-delete_volume" released by "delete_volume" :: held 3.709s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (b2333103-3977-4bdf-9749-d88f4ce1ae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914aa19b-816d-49ec-8a62-56ae36cac7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914aa19b-816d-49ec-8a62-56ae36cac7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1136921621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632c98b9-151b-49f3-8437-7d27de988fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:12Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c171e508-58a4-4689-958d-f238411222d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c171e508-58a4-4689-958d-f238411222d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b85817a-ee51-4632-86d1-9307033deb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b85817a-ee51-4632-86d1-9307033deb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632c98b9-151b-49f3-8437-7d27de988fb3', 'volume_name': 'volume-632c98b9-151b-49f3-8437-7d27de988fb3', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3314369f-c745-440e-a214-40cf76de2bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3314369f-c745-440e-a214-40cf76de2bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef2a89e-a493-4007-94a1-1433284e4f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:12 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Volume 632c98b9-151b-49f3-8437-7d27de988fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632c98b9-151b-49f3-8437-7d27de988fb3', 'volume_size': 1} Sep 05 04:42:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:16 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a" returned: 0 in 8.575s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:42:16 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Converted 1024.00 MB image at 119.41 MB/s Sep 05 04:42:16 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a is being set with open permissions: ugo+rw Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:16 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a Sep 05 04:42:16 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:16 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a" returned: 0 in 0.276s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-f70daf78-a08a-4ec8-949d-d978743b283a" released by "_copy_volume_from_snapshot" :: held 10.162s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-7671165e-8721-4948-a06c-862f15147ec9-f70daf78-a08a-4ec8-949d-d978743b283a" released by "_create_volume_from_snapshot" :: held 10.251s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.285s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.245s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1136921621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632c98b9-151b-49f3-8437-7d27de988fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d18d524902471f897bc3e7cc13a7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:12Z,use_quota=True,user_id='06012c8ad6c04dd8af10d9e76dd78db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Creating volume 632c98b9-151b-49f3-8437-7d27de988fb3 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:16 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b6b6c5-3052-45fa-9027-8ecdfbdd2a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70daf78-a08a-4ec8-949d-d978743b283a', 'volume_size': 1, 'snapshot_id': '7671165e-8721-4948-a06c-862f15147ec9'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:16 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3 1073741824 Sep 05 04:42:16 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4e8a75-d1f9-4d5a-8348-918d377d6ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:16 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Volume volume-f70daf78-a08a-4ec8-949d-d978743b283a (f70daf78-a08a-4ec8-949d-d978743b283a): created successfully Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4e8a75-d1f9-4d5a-8348-918d377d6ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Flow 'volume_create_manager' (714246d8-c5d4-433c-ad53-e84f5b484e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-99bc8de5-2113-459d-9156-1ac1ee303ed7 tempest-VolumesDeleteCascade-270594991 None] Created volume successfully. Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-8a2f39ee-2a02-4f54-ad91-c965d2d7173c-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-8a2f39ee-2a02-4f54-ad91-c965d2d7173c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Performing cascade delete. {{(pid=89807) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-7671165e-8721-4948-a06c-862f15147ec9-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-7671165e-8721-4948-a06c-862f15147ec9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-7671165e-8721-4948-a06c-862f15147ec9" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-7671165e-8721-4948-a06c-862f15147ec9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Deleting offline snapshot 7671165e-8721-4948-a06c-862f15147ec9 of volume 8a2f39ee-2a02-4f54-ad91-c965d2d7173c {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] snapshot_file for this snap is: volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[75746bd7-67c8-4fd6-b6ee-a0466733651f]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:17 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3 1073741824" returned: 0 in 0.684s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:17 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 Sep 05 04:42:17 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:17 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3 Sep 05 04:42:17 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b5e0fe54-78cc-456b-bf54-8386c820eaff tempest-GroupsV314Test-2094850231 None] Group tempest-GroupsV314Test-Group-1659382443: creating Sep 05 04:42:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b5e0fe54-78cc-456b-bf54-8386c820eaff tempest-GroupsV314Test-2094850231 None] Group tempest-GroupsV314Test-Group-1659382443: created successfully Sep 05 04:42:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b5e0fe54-78cc-456b-bf54-8386c820eaff tempest-GroupsV314Test-2094850231 None] Create group completed successfully. Sep 05 04:42:17 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9" returned: 0 in 0.506s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:42:17 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3" returned: 0 in 0.403s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3771bfa-dc37-4e5a-8781-7bd9361d08a6]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef2a89e-a493-4007-94a1-1433284e4f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632c98b9-151b-49f3-8437-7d27de988fb3', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b5fb5f-a889-421c-83f2-3780bac3bdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:18 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Volume volume-632c98b9-151b-49f3-8437-7d27de988fb3 (632c98b9-151b-49f3-8437-7d27de988fb3): created successfully Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b5fb5f-a889-421c-83f2-3780bac3bdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Flow 'volume_create_manager' (b2333103-3977-4bdf-9749-d88f4ce1ae6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:18 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e37a6ad3-16d2-496b-8e82-d3f25a43bf7d tempest-VolumesActionsTest-1268879803 None] Created volume successfully. Sep 05 04:42:18 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c Sep 05 04:42:18 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:18 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" returned: 0 in 0.523s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:18 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 Sep 05 04:42:18 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:18 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9" returned: 0 in 0.325s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:18 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9 Sep 05 04:42:18 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:19 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c.7671165e-8721-4948-a06c-862f15147ec9" returned: 0 in 0.290s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-7671165e-8721-4948-a06c-862f15147ec9" released by "_delete_snapshot" :: held 1.771s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" released by "delete_snapshot" :: held 1.802s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Created reservations ['93669fe5-6528-47b6-aaae-1ea1d1dde89f', 'b8b42d50-8fc9-4df0-842c-107436a43f93', 'abaf9faa-5c8f-474e-b795-a3cfb87dded6', 'f1d076e6-0035-4c7a-b5a7-2749b83bb1bd'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:19 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Delete snapshot completed successfully. Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-7671165e-8721-4948-a06c-862f15147ec9-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Snapshots deleted, issuing volume delete {{(pid=89807) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" acquired by "delete_volume" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df25157-579e-4414-acaa-e8fecdf8fb88]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Flow 'volume_create_manager' (3817bcde-6d37-44cb-a23c-00b3c990b06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad89e1f-6a4f-4768-be22-dab6f62dcf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad89e1f-6a4f-4768-be22-dab6f62dcf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391728239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce5b502a-6404-472f-a9bb-533534f8daa1,host='devstack@QuobyteHD#QuobyteHD',id=1fd2387b-c6e8-4690-80ab-91ec1169fc61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e715038780c4411ebe8b8773c9413fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:20Z,use_quota=True,user_id='28d6ba2764de478b996bf472be655a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87f12e3b-42a1-4f06-a3cd-a038f03a46a8),volume_type_id=87f12e3b-42a1-4f06-a3cd-a038f03a46a8)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:19 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c Sep 05 04:42:19 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4961ac7e-f708-46eb-ab5e-d38aa7a16022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4961ac7e-f708-46eb-ab5e-d38aa7a16022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fd1696-30ce-42b9-8288-511323523343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fd1696-30ce-42b9-8288-511323523343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd2387b-c6e8-4690-80ab-91ec1169fc61', 'volume_name': 'volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe44246-d578-465f-b910-ee651fe1f68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe44246-d578-465f-b910-ee651fe1f68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf822f9-86ff-42e9-819c-c0cc1aef8b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:19 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Volume 1fd2387b-c6e8-4690-80ab-91ec1169fc61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61', 'volume_size': 1} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ce5b502a-6404-472f-a9bb-533534f8daa1,created_at=2026-09-05T02:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391728239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce5b502a-6404-472f-a9bb-533534f8daa1,host='devstack@QuobyteHD#QuobyteHD',id=1fd2387b-c6e8-4690-80ab-91ec1169fc61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e715038780c4411ebe8b8773c9413fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:20Z,use_quota=True,user_id='28d6ba2764de478b996bf472be655a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87f12e3b-42a1-4f06-a3cd-a038f03a46a8),volume_type_id=87f12e3b-42a1-4f06-a3cd-a038f03a46a8)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Creating volume 1fd2387b-c6e8-4690-80ab-91ec1169fc61 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:19 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:42:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:19 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 1073741824 Sep 05 04:42:19 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:20 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" returned: 0 in 0.637s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:20 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c Sep 05 04:42:20 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "cinder-632c98b9-151b-49f3-8437-7d27de988fb3-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Lock "cinder-632c98b9-151b-49f3-8437-7d27de988fb3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "cinder-quobyte-632c98b9-151b-49f3-8437-7d27de988fb3" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Lock "cinder-quobyte-632c98b9-151b-49f3-8437-7d27de988fb3" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3b6b64-3343-4fa2-b60f-38d9923deff3]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:20 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3 Sep 05 04:42:20 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:20 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" returned: 0 in 0.342s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:20 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 1073741824" returned: 0 in 0.642s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-8a2f39ee-2a02-4f54-ad91-c965d2d7173c" released by "delete_volume" :: held 1.056s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:20 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 Sep 05 04:42:20 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Created reservations ['c481688e-b762-4a73-b253-4f87e3c961cd', 'e8633309-15ae-41cb-89c5-5f16c1e00165', 'e1e88903-9b74-4159-a994-da6c90b07bef', 'a2cfc5ee-3a4e-4a63-9ead-21fb8709bc69'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:20 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:20 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:20 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3" returned: 0 in 0.479s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:20 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3 Sep 05 04:42:20 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:21 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61" returned: 0 in 0.463s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:21 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.301s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf822f9-86ff-42e9-819c-c0cc1aef8b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c423c6-4505-46b9-9017-bf5f5882bf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:21 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Deleted volume successfully. Sep 05 04:42:21 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Volume volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 (1fd2387b-c6e8-4690-80ab-91ec1169fc61): created successfully Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c423c6-4505-46b9-9017-bf5f5882bf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Flow 'volume_create_manager' (3817bcde-6d37-44cb-a23c-00b3c990b06e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c445d590-57f5-4a43-8674-873e3a45eea1 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-8a2f39ee-2a02-4f54-ad91-c965d2d7173c-delete_volume" released by "delete_volume" :: held 3.834s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:21 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6ac25367-12ae-424b-9976-2d298d2458ec tempest-GroupsV314Test-2094850231 None] Created volume successfully. Sep 05 04:42:21 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-632c98b9-151b-49f3-8437-7d27de988fb3" returned: 0 in 0.340s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Lock "cinder-quobyte-632c98b9-151b-49f3-8437-7d27de988fb3" released by "delete_volume" :: held 0.862s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Created reservations ['148fee3e-b3a3-4b70-9ef9-cb2bb60d80ed', '35f495b9-c06c-47cf-a567-699921c42279', '3b00afce-2599-4f7c-9005-17734a1550b3', '4317c3df-a772-4850-9d4f-11d1da0eead6'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:21 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:21 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:21 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:21 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Deleted volume successfully. Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d4cf1b0-4e89-43c6-8023-6757330d65c1 tempest-VolumesActionsTest-1268879803 None] Lock "cinder-632c98b9-151b-49f3-8437-7d27de988fb3-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-f70daf78-a08a-4ec8-949d-d978743b283a-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-f70daf78-a08a-4ec8-949d-d978743b283a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "cinder-quobyte-f70daf78-a08a-4ec8-949d-d978743b283a" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-f70daf78-a08a-4ec8-949d-d978743b283a" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3538d89-145a-46ae-8fe3-a83b8c45c952]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:22 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a Sep 05 04:42:22 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:22 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a" returned: 0 in 0.484s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:22 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a Sep 05 04:42:22 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:22 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f70daf78-a08a-4ec8-949d-d978743b283a" returned: 0 in 0.303s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-quobyte-f70daf78-a08a-4ec8-949d-d978743b283a" released by "delete_volume" :: held 0.852s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:22 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Created reservations ['819ee160-fab1-42ec-9fdb-7412678490f4', '2625e14b-1551-488a-a2af-ac197f42e137', 'f3edd902-8cf9-4a0e-a447-32a375ef926c', 'd0d60c4f-21be-4e12-82bd-afe32ed5b3d6'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:23 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:23 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:23 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Cloning volume 1fd2387b-c6e8-4690-80ab-91ec1169fc61 to volume e3946cad-fcb5-4e9f-9db8-4163cffe7007 Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Creating offline snapshot ef525f8e-1af3-47de-b7c7-1602c6890be5 of volume 1fd2387b-c6e8-4690-80ab-91ec1169fc61 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e406f7-648f-4677-a244-671012faaf7c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:23 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.494s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:23 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 Sep 05 04:42:23 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:23 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Deleted volume successfully. Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-128fc272-7dc7-4c0e-bd8a-4c0b16d542a8 tempest-VolumesDeleteCascade-270594991 None] Lock "cinder-f70daf78-a08a-4ec8-949d-d978743b283a-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:23 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61" returned: 0 in 0.497s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:23 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 1G Sep 05 04:42:23 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:24 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 1G" returned: 0 in 0.483s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:24 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 Sep 05 04:42:24 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:24 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5" returned: 0 in 0.369s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:24 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:42:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:24 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 Sep 05 04:42:24 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:24 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5" returned: 0 in 0.280s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:25 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.info Sep 05 04:42:25 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:25 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.info" returned: 0 in 0.297s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:25 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:25 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.info Sep 05 04:42:25 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:25 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.info" returned: 0 in 0.356s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Acquiring lock "cinder-quobyte-e3946cad-fcb5-4e9f-9db8-4163cffe7007" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Lock "cinder-quobyte-e3946cad-fcb5-4e9f-9db8-4163cffe7007" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] snapshot: ef525f8e-1af3-47de-b7c7-1602c6890be5, volume: e3946cad-fcb5-4e9f-9db8-4163cffe7007, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe6dbb-1847-403b-91fe-623e928059b7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:25 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 Sep 05 04:42:25 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:26 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5" returned: 0 in 0.466s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:42:26 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf11ccf-b12d-4d71-b8c9-9a82c8e4c245]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:26 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 Sep 05 04:42:26 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:26 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61" returned: 0 in 0.460s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:42:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:42:26 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:42:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:26 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 Sep 05 04:42:26 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:32 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007" returned: 0 in 5.675s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:42:32 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Converted 1024.00 MB image at 180.41 MB/s Sep 05 04:42:32 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:32 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 Sep 05 04:42:32 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=184,cinder:SELECT=170,cinder:INSERT=47,cinder:DELETE=12 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:42:32 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007" returned: 0 in 0.367s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Flow 'volume_create_manager' (f1015ba1-eaf1-4741-8df5-4a11d0819f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daabdca4-0f11-4d34-a9d6-1ad51e37a840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Lock "cinder-quobyte-e3946cad-fcb5-4e9f-9db8-4163cffe7007" released by "_copy_volume_from_snapshot" :: held 7.095s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Acquiring lock "cinder-quobyte-ef525f8e-1af3-47de-b7c7-1602c6890be5" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daabdca4-0f11-4d34-a9d6-1ad51e37a840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1899191318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e824c8a-6418-44ee-9c6a-53cc04f02859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12961f1ce81433184ca52f358188d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:33Z,use_quota=True,user_id='01bda6d556264e3c8d5bf61f53a2d645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e978bb9c-b6de-4948-b065-0171ce41e760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e978bb9c-b6de-4948-b065-0171ce41e760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f9ac1a-5988-4910-bc9e-98e26ce38f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f9ac1a-5988-4910-bc9e-98e26ce38f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e824c8a-6418-44ee-9c6a-53cc04f02859', 'volume_name': 'volume-5e824c8a-6418-44ee-9c6a-53cc04f02859', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdfe341-b6d8-4228-ac16-a4b98e625124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdfe341-b6d8-4228-ac16-a4b98e625124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb899f0-d38a-4d8b-b137-f1408e974fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:32 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Volume 5e824c8a-6418-44ee-9c6a-53cc04f02859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e824c8a-6418-44ee-9c6a-53cc04f02859', 'volume_size': 1} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Lock "cinder-quobyte-ef525f8e-1af3-47de-b7c7-1602c6890be5" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Deleting offline snapshot ef525f8e-1af3-47de-b7c7-1602c6890be5 of volume 1fd2387b-c6e8-4690-80ab-91ec1169fc61 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] snapshot_file for this snap is: volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4937ff2-afd7-4c15-9ab8-acf36ef8eaf6]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:33 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 Sep 05 04:42:33 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:33 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5" returned: 0 in 0.422s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:42:33 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51b06ed-1e30-4dae-b547-8986308feafd]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:33 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 Sep 05 04:42:33 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:33 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61" returned: 0 in 0.552s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:34 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 Sep 05 04:42:34 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:34 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5" returned: 0 in 0.510s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:34 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5 Sep 05 04:42:34 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:34 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61.ef525f8e-1af3-47de-b7c7-1602c6890be5" returned: 0 in 0.281s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Lock "cinder-quobyte-ef525f8e-1af3-47de-b7c7-1602c6890be5" released by "_delete_snapshot" :: held 1.886s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.603s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1899191318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e824c8a-6418-44ee-9c6a-53cc04f02859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12961f1ce81433184ca52f358188d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:33Z,use_quota=True,user_id='01bda6d556264e3c8d5bf61f53a2d645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Creating volume 5e824c8a-6418-44ee-9c6a-53cc04f02859 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:34 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:42:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:34 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859 1073741824 Sep 05 04:42:34 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a98e2747-972f-43a9-ba5e-6af3ed08092c tempest-GroupsV314Test-2094850231 None] Create group from source-group-ce5b502a-6404-472f-a9bb-533534f8daa1 completed successfully. Sep 05 04:42:35 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859 1073741824" returned: 0 in 0.558s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-27f20b44-dcbe-4cbc-b35c-ad30c1a06a95 req-cf8b4e89-636f-4d1b-8e54-dcdae3af9fea tempest-ServerActionsTestOtherA-289008059 None] Terminate volume connection completed successfully. Sep 05 04:42:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-27f20b44-dcbe-4cbc-b35c-ad30c1a06a95 req-cf8b4e89-636f-4d1b-8e54-dcdae3af9fea tempest-ServerActionsTestOtherA-289008059 None] Deleting attachment 866a5a8d-857d-4b24-af23-367730dd9069. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:42:35 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859 Sep 05 04:42:35 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:35 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859" returned: 0 in 0.303s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb899f0-d38a-4d8b-b137-f1408e974fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e824c8a-6418-44ee-9c6a-53cc04f02859', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfa2a18-33ac-4475-bf98-907582c95182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:35 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Volume volume-5e824c8a-6418-44ee-9c6a-53cc04f02859 (5e824c8a-6418-44ee-9c6a-53cc04f02859): created successfully Sep 05 04:42:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfa2a18-33ac-4475-bf98-907582c95182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Flow 'volume_create_manager' (f1015ba1-eaf1-4741-8df5-4a11d0819f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-769ce905-e5d1-47b9-ab89-7cbbea80094b tempest-VolumesTransfersTest-1309877826 None] Created volume successfully. Sep 05 04:42:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Acquiring lock "cinder-quobyte-e3946cad-fcb5-4e9f-9db8-4163cffe7007" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Lock "cinder-quobyte-e3946cad-fcb5-4e9f-9db8-4163cffe7007" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:36 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd5f216-3a86-4ed0-b169-375d9ce42aff]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:36 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 Sep 05 04:42:36 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:36 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007" returned: 0 in 0.513s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:36 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007 Sep 05 04:42:36 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:37 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e3946cad-fcb5-4e9f-9db8-4163cffe7007" returned: 0 in 0.471s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Lock "cinder-quobyte-e3946cad-fcb5-4e9f-9db8-4163cffe7007" released by "delete_volume" :: held 1.086s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Created reservations ['dc760235-be08-4557-826a-fcaeedc5fc44'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:37 devstack cinder-volume[89807]: WARNING cinder.quota [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-137667060 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-137667060, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:42:37 devstack cinder-volume[89807]: WARNING cinder.quota [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-137667060 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-137667060, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Created reservations ['ee2eb21f-07ac-45e5-a05b-f12e14afc448', '56b43368-0cbd-45db-9371-1e21b523c813', 'f8bb6d2a-2252-4f07-a057-cdec46e8ea2b', '06d2f55d-222d-42ca-ba9e-6e9ca535f4c4'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:37 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:37 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:37 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.337s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:37 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-73f0e3e1-3067-4a5d-bcf6-525e0d03f30f tempest-GroupsV314Test-2094850231 None] Delete group completed successfully. Sep 05 04:42:38 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7b0fc5a7-1493-4d77-9342-831e9804422d tempest-VolumesTransfersTest-658284635 None] Transfer volume completed successfully. Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Acquiring lock "cinder-quobyte-1fd2387b-c6e8-4690-80ab-91ec1169fc61" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Lock "cinder-quobyte-1fd2387b-c6e8-4690-80ab-91ec1169fc61" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5987c0-15bd-4062-b786-1cfa168735b9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:39 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 Sep 05 04:42:39 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Acquiring lock "cinder-5e824c8a-6418-44ee-9c6a-53cc04f02859-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Lock "cinder-5e824c8a-6418-44ee-9c6a-53cc04f02859-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Acquiring lock "cinder-quobyte-5e824c8a-6418-44ee-9c6a-53cc04f02859" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Lock "cinder-quobyte-5e824c8a-6418-44ee-9c6a-53cc04f02859" acquired by "delete_volume" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a549e38-808b-40ba-806d-5eaeb9bdec33]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:39 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61" returned: 0 in 0.612s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:39 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859 Sep 05 04:42:39 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:39 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61 Sep 05 04:42:39 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:39 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1fd2387b-c6e8-4690-80ab-91ec1169fc61" returned: 0 in 0.266s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:40 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Lock "cinder-quobyte-1fd2387b-c6e8-4690-80ab-91ec1169fc61" released by "delete_volume" :: held 0.978s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859" returned: 0 in 0.423s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:40 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859 Sep 05 04:42:40 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Created reservations ['1f273c9c-fb7f-4044-a335-bf9d48d924f2'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Created reservations ['387d1f4b-d4c9-4258-a9b5-e05e7bffabbc', 'e8cbfba4-84ca-40ce-82d2-b0260365ed3f', 'd93f769b-5d28-402b-bba5-c2569987e28d', 'f56797f0-de67-42bb-a43d-5813a386848c'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:40 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:40 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:40 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5e824c8a-6418-44ee-9c6a-53cc04f02859" returned: 0 in 0.299s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Lock "cinder-quobyte-5e824c8a-6418-44ee-9c6a-53cc04f02859" released by "delete_volume" :: held 0.791s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Created reservations ['53a06ade-9466-4efe-befb-a596455e899f', 'f9b4e33b-4391-4459-bc3d-183feca1323f', '4d9dc1e1-03b4-418b-8f9c-cc04e317d688', '4305c764-4bb3-4029-a44d-32f68f6fd6fe'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:40 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.347s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:40 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:40 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-15565973-578a-48e8-91bd-0449e41c7ee7 tempest-GroupsV314Test-2094850231 None] Delete group completed successfully. Sep 05 04:42:40 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:40 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:41 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.454s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:41 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Deleted volume successfully. Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-58abef8a-bc84-4f40-b327-86610dcda695 tempest-VolumesTransfersTest-1225819374 None] Lock "cinder-5e824c8a-6418-44ee-9c6a-53cc04f02859-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Flow 'volume_create_manager' (a1aa4c0a-3996-4014-887e-1e7951f09dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b181b35b-dd33-4929-824e-60d5672a04e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b181b35b-dd33-4929-824e-60d5672a04e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1042897436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f367981-596a-4bc1-a049-08624073d9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12961f1ce81433184ca52f358188d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:42Z,use_quota=True,user_id='01bda6d556264e3c8d5bf61f53a2d645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227712e3-be82-4c47-9d9d-207a0268769e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227712e3-be82-4c47-9d9d-207a0268769e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56df0d5-858e-4f60-ae62-b90a013a0206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56df0d5-858e-4f60-ae62-b90a013a0206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f367981-596a-4bc1-a049-08624073d9ea', 'volume_name': 'volume-5f367981-596a-4bc1-a049-08624073d9ea', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0a478f-9e40-4ae8-a5e7-0d1f9c61e15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0a478f-9e40-4ae8-a5e7-0d1f9c61e15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab673ed5-c325-4fed-8253-af5921fbcfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Volume 5f367981-596a-4bc1-a049-08624073d9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f367981-596a-4bc1-a049-08624073d9ea', 'volume_size': 1} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1042897436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f367981-596a-4bc1-a049-08624073d9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12961f1ce81433184ca52f358188d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:42Z,use_quota=True,user_id='01bda6d556264e3c8d5bf61f53a2d645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Creating volume 5f367981-596a-4bc1-a049-08624073d9ea {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:41 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:42:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:41 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea 1073741824 Sep 05 04:42:41 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:42 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea 1073741824" returned: 0 in 0.598s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:42 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea Sep 05 04:42:42 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:42 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea" returned: 0 in 0.346s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab673ed5-c325-4fed-8253-af5921fbcfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f367981-596a-4bc1-a049-08624073d9ea', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c43d03d-e0ed-45dd-a28f-c30535f5b07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Volume volume-5f367981-596a-4bc1-a049-08624073d9ea (5f367981-596a-4bc1-a049-08624073d9ea): created successfully Sep 05 04:42:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c43d03d-e0ed-45dd-a28f-c30535f5b07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Flow 'volume_create_manager' (a1aa4c0a-3996-4014-887e-1e7951f09dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1d2b10ee-7995-4e59-97dd-585a3f8d1e15 tempest-VolumesTransfersTest-1309877826 None] Created volume successfully. Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Flow 'volume_create_manager' (24e6ac36-7d9d-458d-bef6-0ded94e4c2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c2ce63-428a-4e33-ad78-79f6debf2855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Acquiring lock "cinder-5f367981-596a-4bc1-a049-08624073d9ea-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c2ce63-428a-4e33-ad78-79f6debf2855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1658988148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94275fd3-88ed-4ecd-9985-f9c13e1f3ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78abc04c12064619ad2e1460194ac140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:43Z,use_quota=True,user_id='5cb64b67e81a418b8f55a473bc6da26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b58be2-22ed-4783-91f3-b738a5d6bd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b58be2-22ed-4783-91f3-b738a5d6bd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4376c6-3532-41de-8f67-020436bb6c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.image.glance [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Creating Keystone auth plugin from conf {{(pid=89807) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Flow 'volume_create_manager' (04f0c1a8-7be7-4c14-9d49-7fe1470c4e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c8b866-a050-4616-a5fa-85531a81bee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Lock "cinder-5f367981-596a-4bc1-a049-08624073d9ea-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c8b866-a050-4616-a5fa-85531a81bee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1067307881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e7fdce-ac22-4f8b-ba6a-93c434fb25ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1749d584564a24a8e20b77dab3f987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:43Z,use_quota=True,user_id='5d30d14fce754153abc5515e059ed3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc126dfa-356c-434c-a710-33159207441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc126dfa-356c-434c-a710-33159207441b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafb4577-a3dc-4f5b-a993-1689fd77455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafb4577-a3dc-4f5b-a993-1689fd77455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e7fdce-ac22-4f8b-ba6a-93c434fb25ed', 'volume_name': 'volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb3fda3-88fa-423a-936b-d3dc95f4f678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb3fda3-88fa-423a-936b-d3dc95f4f678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4202ca8d-ef03-42b0-b2cf-7358a5d7914e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:43 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Volume 08e7fdce-ac22-4f8b-ba6a-93c434fb25ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed', 'volume_size': 1} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1067307881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e7fdce-ac22-4f8b-ba6a-93c434fb25ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1749d584564a24a8e20b77dab3f987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:43Z,use_quota=True,user_id='5d30d14fce754153abc5515e059ed3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Creating volume 08e7fdce-ac22-4f8b-ba6a-93c434fb25ed {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:43 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:43 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed 1073741824 Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Acquiring lock "cinder-quobyte-5f367981-596a-4bc1-a049-08624073d9ea" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:43 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Lock "cinder-quobyte-5f367981-596a-4bc1-a049-08624073d9ea" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[24119635-30fc-4a94-9f3f-9328cce4243b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:43 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea Sep 05 04:42:43 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4376c6-3532-41de-8f67-020436bb6c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94275fd3-88ed-4ecd-9985-f9c13e1f3ae7', 'volume_name': 'volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475fee3b-e73f-4118-85d7-ef8242ac4979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475fee3b-e73f-4118-85d7-ef8242ac4979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e550fd-0ca7-4e3e-8495-03d49724ee0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:43 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Volume 94275fd3-88ed-4ecd-9985-f9c13e1f3ae7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 04:42:43 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Trying to clone 94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 from image d96433d1-6b83-48c1-88e8-5f747cd5fb19 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]). {{(pid=89807) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 04:42:44 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea" returned: 0 in 0.560s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:44 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:44 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea Sep 05 04:42:44 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed 1073741824" returned: 0 in 0.711s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:44 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed Sep 05 04:42:44 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 04:42:44 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Image download 20.69 MB at 20.69 MB/s Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa862947-d3ec-4558-95db-cead47cff7ad]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:44 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5f367981-596a-4bc1-a049-08624073d9ea" returned: 0 in 0.308s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Lock "cinder-quobyte-5f367981-596a-4bc1-a049-08624073d9ea" released by "delete_volume" :: held 0.935s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Created reservations ['f9946707-61d9-4dc9-8642-6075d6ead22c', 'fa7b9456-29cc-4fea-87a0-fbc47c4a2dd6', '99d73bfe-b0ed-4d57-9dc7-326bda9e3e7c', '9aabfa4b-ee4a-4062-96ab-c0cba476b880'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:44 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed" returned: 0 in 0.310s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:44 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD Sep 05 04:42:44 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4202ca8d-ef03-42b0-b2cf-7358a5d7914e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80efac98-d952-4082-9286-e3391dbcd943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:44 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Volume volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed (08e7fdce-ac22-4f8b-ba6a-93c434fb25ed): created successfully Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80efac98-d952-4082-9286-e3391dbcd943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Flow 'volume_create_manager' (04f0c1a8-7be7-4c14-9d49-7fe1470c4e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7d23daaa-d620-46b3-81f4-5bd3127a2f2b tempest-VolumesTransfersV357Test-63593742 None] Created volume successfully. Sep 05 04:42:44 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:44 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:45 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Temporary image d96433d1-6b83-48c1-88e8-5f747cd5fb19 is fetched for user 5cb64b67e81a418b8f55a473bc6da26b. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd20876d-e10e-418f-850f-4664b7601c3f]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:45 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.273s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Deleted volume successfully. Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ba2f755-2702-4004-8a82-651c3349bdf5 tempest-VolumesTransfersTest-1225819374 None] Lock "cinder-5f367981-596a-4bc1-a049-08624073d9ea-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:45 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD Sep 05 04:42:45 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:45 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1658988148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94275fd3-88ed-4ecd-9985-f9c13e1f3ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78abc04c12064619ad2e1460194ac140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:43Z,use_quota=True,user_id='5cb64b67e81a418b8f55a473bc6da26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Creating volume 94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:45 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:42:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:45 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 1073741824 Sep 05 04:42:45 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:46 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 1073741824" returned: 0 in 0.599s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:46 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 Sep 05 04:42:46 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:46 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7" returned: 0 in 0.336s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f2f0763c-35bb-42e2-b104-6a1d245b7cba tempest-VolumesTransfersV357Test-2007817754 None] Transfer volume completed successfully. Sep 05 04:42:46 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Attempting download of d96433d1-6b83-48c1-88e8-5f747cd5fb19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}])) to volume 94275fd3-88ed-4ecd-9985-f9c13e1f3ae7. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 04:42:46 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f3c2f6-97ae-4d01-bd21-d5c746a18fe2]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_4g43cf4i {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:46 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_4g43cf4i Sep 05 04:42:46 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:46 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_4g43cf4i" returned: 0 in 0.378s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_4g43cf4i {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:47 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_4g43cf4i Sep 05 04:42:47 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Acquiring lock "cinder-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Lock "cinder-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:47 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_4g43cf4i" returned: 1 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_4g43cf4i' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3aebb7-2f19-4511-a4f8-456902556170]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Acquiring lock "cinder-quobyte-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Lock "cinder-quobyte-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed" acquired by "delete_volume" :: waited 0.029s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:47 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD Sep 05 04:42:47 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba17c380-e1a5-4e63-9bf2-a5d88d6d5c2c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:47 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed Sep 05 04:42:47 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:47 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] d96433d1-6b83-48c1-88e8-5f747cd5fb19 was qcow2, converting to qcow2 {{(pid=89807) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 04:42:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:47 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 Sep 05 04:42:47 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:48 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed" returned: 0 in 0.511s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:48 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed Sep 05 04:42:48 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:48 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed" returned: 0 in 0.364s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Lock "cinder-quobyte-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed" released by "delete_volume" :: held 0.949s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Created reservations ['1705729a-07e2-45e3-b11b-c3ce8f4624d7', '3c6285ef-d7a7-4743-99ad-1f561a74043f', '7e62e8eb-976c-4e80-997d-eb083353164a', 'f68f84ad-3fca-4632-9b82-11ef126b46b0'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e851edda-3285-400d-ad49-b804f66957cd tempest-GroupsV320Test-192075579 None] Group tempest-GroupsV320Test-Group-1487122383: creating Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:48 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:48 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e851edda-3285-400d-ad49-b804f66957cd tempest-GroupsV320Test-192075579 None] Group tempest-GroupsV320Test-Group-1487122383: created successfully Sep 05 04:42:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e851edda-3285-400d-ad49-b804f66957cd tempest-GroupsV320Test-192075579 None] Create group completed successfully. Sep 05 04:42:48 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.281s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Deleted volume successfully. Sep 05 04:42:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7260010-a134-4745-9330-05b04ac93e89 tempest-VolumesTransfersV357Test-2120784868 None] Lock "cinder-08e7fdce-ac22-4f8b-ba6a-93c434fb25ed-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:50 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7" returned: 0 in 2.193s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_74auj6hmdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:42:50 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Converted 112.00 MB image at 51.04 MB/s Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:50 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 1G Sep 05 04:42:50 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Flow 'volume_create_manager' (969beb48-b0da-4e5a-bbd9-d19af16fcd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398d6e3c-6011-4b80-8cd9-05c55b77669e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398d6e3c-6011-4b80-8cd9-05c55b77669e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-322567026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1749d584564a24a8e20b77dab3f987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:50Z,use_quota=True,user_id='5d30d14fce754153abc5515e059ed3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e35117-840a-464b-999e-be0793ddd421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e35117-840a-464b-999e-be0793ddd421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb22a9b8-5bd1-455d-acef-b871105d9a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb22a9b8-5bd1-455d-acef-b871105d9a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6', 'volume_name': 'volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe276d51-f450-4bf4-9be1-1a649d89bba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe276d51-f450-4bf4-9be1-1a649d89bba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c85e46-3c5a-403f-89bf-e664ba270d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:50 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Volume c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6', 'volume_size': 1} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-322567026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1749d584564a24a8e20b77dab3f987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:50Z,use_quota=True,user_id='5d30d14fce754153abc5515e059ed3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Creating volume c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:50 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:50 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 1073741824 Sep 05 04:42:50 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-fde6c3db-aa3b-419a-96fc-30e4a22ecd3c tempest-GroupsV320Test-192075579 None] Created reservations ['c359a448-f1e6-4267-b823-6be45cde0652'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fde6c3db-aa3b-419a-96fc-30e4a22ecd3c tempest-GroupsV320Test-192075579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fde6c3db-aa3b-419a-96fc-30e4a22ecd3c tempest-GroupsV320Test-192075579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fde6c3db-aa3b-419a-96fc-30e4a22ecd3c tempest-GroupsV320Test-192075579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:50 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fde6c3db-aa3b-419a-96fc-30e4a22ecd3c tempest-GroupsV320Test-192075579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fde6c3db-aa3b-419a-96fc-30e4a22ecd3c tempest-GroupsV320Test-192075579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fde6c3db-aa3b-419a-96fc-30e4a22ecd3c tempest-GroupsV320Test-192075579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 1G" returned: 0 in 0.603s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Downloaded image d96433d1-6b83-48c1-88e8-5f747cd5fb19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}])) to volume 94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 successfully. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Temporary image d96433d1-6b83-48c1-88e8-5f747cd5fb19 for user 5cb64b67e81a418b8f55a473bc6da26b is deleted. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Marking volume 94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 as bootable. {{(pid=89807) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 04:42:50 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:50 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Copying metadata from image d96433d1-6b83-48c1-88e8-5f747cd5fb19 to 94275fd3-88ed-4ecd-9985-f9c13e1f3ae7. {{(pid=89807) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Creating volume glance metadata for volume 94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 backed by image d96433d1-6b83-48c1-88e8-5f747cd5fb19 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89807) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e550fd-0ca7-4e3e-8495-03d49724ee0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd32f58a-d6c3-43b9-9624-1af1d569c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:50 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Volume volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 (94275fd3-88ed-4ecd-9985-f9c13e1f3ae7): created successfully Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd32f58a-d6c3-43b9-9624-1af1d569c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Flow 'volume_create_manager' (24e6ac36-7d9d-458d-bef6-0ded94e4c2f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:50 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-348b04d1-4261-4fc4-80bf-ea6ff68a2147 tempest-ServerActionsTestOtherA-289008059 None] Created volume successfully. Sep 05 04:42:50 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fde6c3db-aa3b-419a-96fc-30e4a22ecd3c tempest-GroupsV320Test-192075579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.371s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:50 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-fde6c3db-aa3b-419a-96fc-30e4a22ecd3c tempest-GroupsV320Test-192075579 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:51 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-fde6c3db-aa3b-419a-96fc-30e4a22ecd3c tempest-GroupsV320Test-192075579 None] Delete group completed successfully. Sep 05 04:42:51 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 1073741824" returned: 0 in 0.612s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:51 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 Sep 05 04:42:51 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:51 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6" returned: 0 in 0.284s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c85e46-3c5a-403f-89bf-e664ba270d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfa549d-3f2b-4c24-9180-f39b5c8d6221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:51 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Volume volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 (c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6): created successfully Sep 05 04:42:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfa549d-3f2b-4c24-9180-f39b5c8d6221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Flow 'volume_create_manager' (969beb48-b0da-4e5a-bbd9-d19af16fcd3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:51 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-361916cb-24a1-4ae6-8bf0-39b3bcb002d7 tempest-VolumesTransfersV357Test-63593742 None] Created volume successfully. Sep 05 04:42:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Acquiring lock "cinder-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Lock "cinder-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:52 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=204,cinder:SELECT=176,cinder:INSERT=50,cinder:DELETE=15 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:42:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Acquiring lock "cinder-quobyte-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:42:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Lock "cinder-quobyte-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:42:52 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b527ac-b6c1-4e14-8f4a-f5f7de886809]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:52 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 Sep 05 04:42:52 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:53 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6" returned: 0 in 0.469s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:53 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6 Sep 05 04:42:53 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:53 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6" returned: 0 in 0.300s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Lock "cinder-quobyte-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6" released by "delete_volume" :: held 0.831s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Created reservations ['9a528884-ddab-4af7-8e44-91b4969b5777', '1ee39709-85fa-44c5-a0c5-b6a289602e10', '1c917712-c571-44de-a35d-3396739702af', '6d779405-d100-4ab6-a827-2258d7a12874'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:53 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:42:53 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:54 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.393s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:42:54 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Deleted volume successfully. Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d6920ab-acae-422c-a3ac-3acc644320df tempest-VolumesTransfersV357Test-2120784868 None] Lock "cinder-c3528e09-bee0-47fa-9c74-0a2b2d5d0eb6-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Flow 'volume_create_manager' (a7844b76-50f1-4855-b26d-2d2dfd06c78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc41b27-0b78-4bdd-ac66-892a359835d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc41b27-0b78-4bdd-ac66-892a359835d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1640600663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5809a8fd-f5f9-45f0-8384-01baff96846c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09af79486f647fd98d690e9fe69dd7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:54Z,use_quota=True,user_id='44b53eb32531408785fb92a446ae13ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b787d3-8324-4407-ae5f-042a1734e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b787d3-8324-4407-ae5f-042a1734e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc02c765-e3e1-4ac6-b010-dda3fb010b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc02c765-e3e1-4ac6-b010-dda3fb010b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5809a8fd-f5f9-45f0-8384-01baff96846c', 'volume_name': 'volume-5809a8fd-f5f9-45f0-8384-01baff96846c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a553fc56-ee56-4f8e-b392-d3ca47fc7fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a553fc56-ee56-4f8e-b392-d3ca47fc7fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e96789b-8bc8-4662-b270-14532e0982d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:54 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Volume 5809a8fd-f5f9-45f0-8384-01baff96846c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5809a8fd-f5f9-45f0-8384-01baff96846c', 'volume_size': 1} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1640600663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5809a8fd-f5f9-45f0-8384-01baff96846c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09af79486f647fd98d690e9fe69dd7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:42:54Z,use_quota=True,user_id='44b53eb32531408785fb92a446ae13ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Creating volume 5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:42:54 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:42:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:54 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c 1073741824 Sep 05 04:42:54 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:55 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c 1073741824" returned: 0 in 0.607s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:55 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c Sep 05 04:42:55 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:55 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c" returned: 0 in 0.427s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:42:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e96789b-8bc8-4662-b270-14532e0982d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5809a8fd-f5f9-45f0-8384-01baff96846c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114bce1d-04ea-4ece-ac88-b347686f90f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:42:55 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Volume volume-5809a8fd-f5f9-45f0-8384-01baff96846c (5809a8fd-f5f9-45f0-8384-01baff96846c): created successfully Sep 05 04:42:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114bce1d-04ea-4ece-ac88-b347686f90f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:42:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Flow 'volume_create_manager' (a7844b76-50f1-4855-b26d-2d2dfd06c78e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:42:55 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b66864de-c6a0-41f2-8c0e-1fbeca4b9a74 tempest-VolumesSnapshotListTestJSON-695335607 None] Created volume successfully. Sep 05 04:42:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-0a1074fe-2da4-40cd-a522-e48f851998f1 req-4c83821c-18b8-4914-b017-e20a526629e1 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-0a1074fe-2da4-40cd-a522-e48f851998f1 req-4c83821c-18b8-4914-b017-e20a526629e1 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-0a1074fe-2da4-40cd-a522-e48f851998f1 req-4c83821c-18b8-4914-b017-e20a526629e1 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-0a1074fe-2da4-40cd-a522-e48f851998f1 req-4c83821c-18b8-4914-b017-e20a526629e1 tempest-ServerActionsTestOtherA-289008059 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'beed3a68-737c-4a61-a673-ccb35325cea3', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:42:56 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-0a1074fe-2da4-40cd-a522-e48f851998f1 req-4c83821c-18b8-4914-b017-e20a526629e1 tempest-ServerActionsTestOtherA-289008059 None] attachment_update completed successfully. Sep 05 04:42:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:42:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:42:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Creating offline snapshot 21b10c04-4227-4bd4-8010-4c15324c9d03 of volume 5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:42:56 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[69106a03-d8a1-470d-89d7-4fb8b4a38c71]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:42:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:57 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c Sep 05 04:42:57 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:57 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c" returned: 0 in 0.530s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:57 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 1G Sep 05 04:42:57 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:57 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 1G" returned: 0 in 0.552s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5809a8fd-f5f9-45f0-8384-01baff96846c -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:57 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5809a8fd-f5f9-45f0-8384-01baff96846c -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 Sep 05 04:42:57 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:58 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5809a8fd-f5f9-45f0-8384-01baff96846c -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03" returned: 0 in 0.391s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:58 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 is being set with open permissions: ugo+rw Sep 05 04:42:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:58 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 Sep 05 04:42:58 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:58 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03" returned: 0 in 0.356s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:58 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.info Sep 05 04:42:58 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:59 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.info" returned: 0 in 0.386s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:59 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.info is being set with open permissions: ugo+rw Sep 05 04:42:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:42:59 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.info Sep 05 04:42:59 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:42:59 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 05 04:42:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.info" returned: 0 in 0.391s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:42:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.773s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:42:59 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a23e96b1-83a4-4ae9-9e5e-602c22156a7e tempest-VolumesSnapshotListTestJSON-695335607 None] Create snapshot completed successfully Sep 05 04:43:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] Creating offline snapshot 68a68695-21a2-487c-8162-f340db4747c6 of volume 5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:43:00 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe64780-5ed1-470d-9ccc-ddd288587e42]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:00 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 Sep 05 04:43:00 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:01 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03" returned: 0 in 0.592s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5809a8fd-f5f9-45f0-8384-01baff96846c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:01 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 1G Sep 05 04:43:01 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Flow 'volume_create_manager' (efa9e78c-3c34-4d98-8ba3-d7bba49c3c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bae088d-4766-45ab-a06d-d673733398d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bae088d-4766-45ab-a06d-d673733398d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-867757046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b6aeb9-2ef5-4240-8117-5254223cfa78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286729cfbce047799ff916671286db7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:02Z,use_quota=True,user_id='270fb5f881b64c97bd8399b4b73ab8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9688f4-87bf-4643-b207-8cfb593010ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9688f4-87bf-4643-b207-8cfb593010ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14419915-0b3a-45b7-a952-96f8926cb8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14419915-0b3a-45b7-a952-96f8926cb8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b6aeb9-2ef5-4240-8117-5254223cfa78', 'volume_name': 'volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117503f1-56c5-40a4-ae2b-19e054ca2da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117503f1-56c5-40a4-ae2b-19e054ca2da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05c24fd-3a53-4687-af4b-0c15857ff65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:01 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Volume f7b6aeb9-2ef5-4240-8117-5254223cfa78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78', 'volume_size': 1} Sep 05 04:43:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:02 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 1G" returned: 0 in 0.850s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:02 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 Sep 05 04:43:02 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:02 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6" returned: 0 in 0.436s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:02 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 is being set with open permissions: ugo+rw Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:02 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 Sep 05 04:43:02 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:02 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6" returned: 0 in 0.439s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.029s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-867757046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b6aeb9-2ef5-4240-8117-5254223cfa78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286729cfbce047799ff916671286db7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:02Z,use_quota=True,user_id='270fb5f881b64c97bd8399b4b73ab8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Creating volume f7b6aeb9-2ef5-4240-8117-5254223cfa78 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:43:02 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:43:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:03 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1c29f466-e044-4cb2-a872-ffaa6ecf2bca tempest-VolumesSnapshotListTestJSON-695335607 None] Create snapshot completed successfully Sep 05 04:43:03 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78 1073741824 Sep 05 04:43:03 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:03 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78 1073741824" returned: 0 in 0.629s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:03 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78 Sep 05 04:43:03 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:04 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78" returned: 0 in 0.503s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.165s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05c24fd-3a53-4687-af4b-0c15857ff65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627fcf0c-e2fa-486b-89a3-d1cf0f28dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] Creating offline snapshot 2f8d1438-2dfe-47f2-97b4-5770e41db622 of volume 5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a88e6f5-272c-49a2-af10-2927b3c2fc1e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:04 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Volume volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78 (f7b6aeb9-2ef5-4240-8117-5254223cfa78): created successfully Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627fcf0c-e2fa-486b-89a3-d1cf0f28dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Flow 'volume_create_manager' (efa9e78c-3c34-4d98-8ba3-d7bba49c3c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:04 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b071cecf-f632-49c1-b220-18ae09f8e184 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Created volume successfully. Sep 05 04:43:04 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 Sep 05 04:43:04 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:04 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6" returned: 0 in 0.617s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5809a8fd-f5f9-45f0-8384-01baff96846c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:43:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:04 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 1G Sep 05 04:43:04 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Acquiring lock "cinder-f7b6aeb9-2ef5-4240-8117-5254223cfa78-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "cinder-f7b6aeb9-2ef5-4240-8117-5254223cfa78-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Acquiring lock "cinder-quobyte-f7b6aeb9-2ef5-4240-8117-5254223cfa78" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:05 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 1G" returned: 0 in 0.755s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "cinder-quobyte-f7b6aeb9-2ef5-4240-8117-5254223cfa78" acquired by "delete_volume" :: waited 0.051s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:05 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 Sep 05 04:43:05 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:05 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc13eb1-89d1-4cdd-9113-9a53b1859f8e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:05 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78 Sep 05 04:43:05 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:06 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622" returned: 0 in 0.526s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:06 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 is being set with open permissions: ugo+rw Sep 05 04:43:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:06 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 Sep 05 04:43:06 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:06 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78" returned: 0 in 0.670s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:06 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78 Sep 05 04:43:06 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:06 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622" returned: 0 in 0.539s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b11525b6-f75f-4a97-8f56-9d6a9b6b71cf tempest-VolumesSnapshotListTestJSON-695335607 None] Create snapshot completed successfully Sep 05 04:43:06 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Flow 'volume_create_manager' (c8ecc8a5-9527-4263-b1ce-39a586647374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b2c9b4-2f86-49a8-b162-700bbe8d6451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:07 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f7b6aeb9-2ef5-4240-8117-5254223cfa78" returned: 0 in 0.602s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b2c9b4-2f86-49a8-b162-700bbe8d6451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2119499643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e28c7c9-ae02-42ea-848e-896ec5b9a4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0ddc6c56094a76a284aa5ebc29aeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:07Z,use_quota=True,user_id='0be005456fc94100b2ae81bcaae1f770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1b162f-1d9d-492b-9fa1-d6f5e6187ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1b162f-1d9d-492b-9fa1-d6f5e6187ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc26f06-b5d8-4b67-8280-d83388669d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.image.glance [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Creating Keystone auth plugin from conf {{(pid=89807) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "cinder-quobyte-f7b6aeb9-2ef5-4240-8117-5254223cfa78" released by "delete_volume" :: held 1.393s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Created reservations ['bb7c2bbe-6580-4104-ac9e-87550cca2d07', 'b52885e8-d424-44f1-94c4-08d17d120bba', '4fb5b54a-b2a2-4e24-91e3-570cfa5bada4', 'f935b938-0e9c-4d0c-ae6f-641e671aebb4'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:07 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:07 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc26f06-b5d8-4b67-8280-d83388669d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e28c7c9-ae02-42ea-848e-896ec5b9a4a2', 'volume_name': 'volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded954dd-b89f-4cfe-85ee-b4c9e14ab709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded954dd-b89f-4cfe-85ee-b4c9e14ab709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82292d8f-5f29-4cf7-b03b-35e809fb2797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:07 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Volume 0e28c7c9-ae02-42ea-848e-896ec5b9a4a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Trying to clone 0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 from image d96433d1-6b83-48c1-88e8-5f747cd5fb19 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]). {{(pid=89807) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 04:43:07 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.524s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:07 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Deleted volume successfully. Sep 05 04:43:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a41a6cbd-9b3b-4a81-bcd0-fcc286541807 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "cinder-f7b6aeb9-2ef5-4240-8117-5254223cfa78-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:08 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 04:43:08 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Image download 20.69 MB at 20.69 MB/s Sep 05 04:43:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[634c3418-2a3e-4c8c-a4e6-d4b3887625e1]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:08 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD Sep 05 04:43:08 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:09 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD" returned: 0 in 0.975s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Temporary image d96433d1-6b83-48c1-88e8-5f747cd5fb19 is fetched for user 0be005456fc94100b2ae81bcaae1f770. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-2f8d1438-2dfe-47f2-97b4-5770e41db622-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-2f8d1438-2dfe-47f2-97b4-5770e41db622-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Flow 'volume_create_manager' (b56deec2-870f-4c2c-b322-95a07c092270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c4cbc4-4c21-49aa-a483-2b1dcc957e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" acquired by "delete_snapshot" :: waited 0.059s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-quobyte-2f8d1438-2dfe-47f2-97b4-5770e41db622" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c4cbc4-4c21-49aa-a483-2b1dcc957e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-396993767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519fa136-41a5-456e-be39-83ba2faeacde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286729cfbce047799ff916671286db7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:10Z,use_quota=True,user_id='270fb5f881b64c97bd8399b4b73ab8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37698f0c-6ba3-43b9-8820-6c9a8c6dd3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37698f0c-6ba3-43b9-8820-6c9a8c6dd3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb93caf2-98a1-4f6a-9a1a-15d7148f3bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb93caf2-98a1-4f6a-9a1a-15d7148f3bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519fa136-41a5-456e-be39-83ba2faeacde', 'volume_name': 'volume-519fa136-41a5-456e-be39-83ba2faeacde', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f5bb3b-ec12-4a70-bf1e-0dded66d916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f5bb3b-ec12-4a70-bf1e-0dded66d916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27987f8e-ddbc-4f78-a9ad-b10c7ba33a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:09 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Volume 519fa136-41a5-456e-be39-83ba2faeacde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519fa136-41a5-456e-be39-83ba2faeacde', 'volume_size': 1} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-396993767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519fa136-41a5-456e-be39-83ba2faeacde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286729cfbce047799ff916671286db7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:10Z,use_quota=True,user_id='270fb5f881b64c97bd8399b4b73ab8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Creating volume 519fa136-41a5-456e-be39-83ba2faeacde {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:43:09 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0f7437-3377-4317-9a6a-6ad46b62ec11]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:09 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde 1073741824 Sep 05 04:43:09 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-2f8d1438-2dfe-47f2-97b4-5770e41db622" acquired by "_delete_snapshot" :: waited 0.100s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Deleting offline snapshot 2f8d1438-2dfe-47f2-97b4-5770e41db622 of volume 5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] snapshot_file for this snap is: volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c915afb-9673-46a8-b699-0471a49bcde4]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:10 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD Sep 05 04:43:10 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:10 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 Sep 05 04:43:10 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:10 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:10 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde 1073741824" returned: 0 in 0.638s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:10 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622" returned: 0 in 0.588s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5809a8fd-f5f9-45f0-8384-01baff96846c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f4b78f-de2d-4f50-bcda-b903034093c5]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:10 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde Sep 05 04:43:10 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:10 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:10 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:10 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 Sep 05 04:43:10 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:11 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde" returned: 0 in 0.512s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.737s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2119499643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e28c7c9-ae02-42ea-848e-896ec5b9a4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0ddc6c56094a76a284aa5ebc29aeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:07Z,use_quota=True,user_id='0be005456fc94100b2ae81bcaae1f770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Creating volume 0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:43:11 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:43:11 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.542s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:43:11 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 1073741824 Sep 05 04:43:11 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27987f8e-ddbc-4f78-a9ad-b10c7ba33a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519fa136-41a5-456e-be39-83ba2faeacde', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd28609-7772-4a9c-a760-a4bb54fd0d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:11 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6" returned: 0 in 0.660s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5809a8fd-f5f9-45f0-8384-01baff96846c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:11 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Volume volume-519fa136-41a5-456e-be39-83ba2faeacde (519fa136-41a5-456e-be39-83ba2faeacde): created successfully Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd28609-7772-4a9c-a760-a4bb54fd0d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:11 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 Sep 05 04:43:11 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Flow 'volume_create_manager' (b56deec2-870f-4c2c-b322-95a07c092270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:11 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1a8e5ebc-a401-41f6-9559-9cbccecdd957 tempest-VolumeQuotasAdminTestJSON-1819845906 None] Created volume successfully. Sep 05 04:43:11 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 1073741824" returned: 0 in 0.690s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:11 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622" returned: 0 in 0.686s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:11 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 Sep 05 04:43:11 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:11 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622 Sep 05 04:43:11 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:12 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2" returned: 0 in 0.486s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Attempting download of d96433d1-6b83-48c1-88e8-5f747cd5fb19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}])) to volume 0e28c7c9-ae02-42ea-848e-896ec5b9a4a2. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 04:43:12 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.2f8d1438-2dfe-47f2-97b4-5770e41db622" returned: 0 in 0.587s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-2f8d1438-2dfe-47f2-97b4-5770e41db622" released by "_delete_snapshot" :: held 2.696s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9bf5a8-ab5c-4f30-8a47-57bd89dd0588]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19__frwnlhk {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" released by "delete_snapshot" :: held 2.822s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Created reservations ['845cd9f6-c96e-4cd5-a362-b60b7e4b564b', 'c61e48c4-a4a3-4527-88e9-55967e007565', '08504449-4449-4ea2-94b2-24c0d2718dec', '960b596e-956c-45e5-8de9-655c31d37f46'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:12 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19__frwnlhk Sep 05 04:43:12 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:12 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Delete snapshot completed successfully. Sep 05 04:43:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4ebc4c8-6b7a-483b-9501-5b466685ddc9 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-2f8d1438-2dfe-47f2-97b4-5770e41db622-delete_snapshot" released by "delete_snapshot" :: held 3.138s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:13 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8a8a5ea9-8be4-4039-a4fe-1a7508cb9c88 tempest-VolumeQuotasAdminTestJSON-680475833 None] Transfer volume completed successfully. Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-68a68695-21a2-487c-8162-f340db4747c6-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-68a68695-21a2-487c-8162-f340db4747c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-quobyte-68a68695-21a2-487c-8162-f340db4747c6" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-68a68695-21a2-487c-8162-f340db4747c6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Deleting offline snapshot 68a68695-21a2-487c-8162-f340db4747c6 of volume 5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] snapshot_file for this snap is: volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e136ca-feea-4019-bda1-4254688c153a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:13 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19__frwnlhk" returned: 0 in 0.648s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19__frwnlhk {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:13 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 Sep 05 04:43:13 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:13 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19__frwnlhk Sep 05 04:43:13 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Acquiring lock "cinder-519fa136-41a5-456e-be39-83ba2faeacde-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:13 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6" returned: 0 in 0.788s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5809a8fd-f5f9-45f0-8384-01baff96846c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:43:13 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19__frwnlhk" returned: 1 in 0.820s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19__frwnlhk' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[16429d84-a11a-4e6b-914c-5a6c508cdcd6]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Lock "cinder-519fa136-41a5-456e-be39-83ba2faeacde-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0246371e-ba4d-4114-879a-a0c9da843077]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:14 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-e5f3a105-e220-4c12-91eb-887467b62feb req-d91e701f-3eee-4a67-8e64-7cf0060825ad tempest-ServerActionsTestOtherA-289008059 None] Terminate volume connection completed successfully. Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-e5f3a105-e220-4c12-91eb-887467b62feb req-d91e701f-3eee-4a67-8e64-7cf0060825ad tempest-ServerActionsTestOtherA-289008059 None] Deleting attachment beed3a68-737c-4a61-a673-ccb35325cea3. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:43:14 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 Sep 05 04:43:14 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Acquiring lock "cinder-quobyte-519fa136-41a5-456e-be39-83ba2faeacde" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:14 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD Sep 05 04:43:14 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Lock "cinder-quobyte-519fa136-41a5-456e-be39-83ba2faeacde" acquired by "delete_volume" :: waited 0.050s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[18937a25-d51c-4a75-b08d-01464e57ed01]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:14 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03" returned: 0 in 0.554s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5809a8fd-f5f9-45f0-8384-01baff96846c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:14 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde Sep 05 04:43:14 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 Sep 05 04:43:14 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:14 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:14 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD" returned: 0 in 0.632s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] d96433d1-6b83-48c1-88e8-5f747cd5fb19 was qcow2, converting to qcow2 {{(pid=89807) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:14 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 Sep 05 04:43:14 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:14 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde" returned: 0 in 0.600s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:15 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde Sep 05 04:43:15 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:15 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6" returned: 0 in 0.591s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:15 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6 Sep 05 04:43:15 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:15 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-519fa136-41a5-456e-be39-83ba2faeacde" returned: 0 in 0.362s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Lock "cinder-quobyte-519fa136-41a5-456e-be39-83ba2faeacde" released by "delete_volume" :: held 1.031s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Created reservations ['dc10e8c9-9a8a-4941-9f23-e03366a8de3a', '7d953cc1-855b-4c80-a730-7a631c8e5a0d', '759a1c92-dde8-4932-891c-789b2b111b29', '15c36153-8a2f-480e-8625-00ad39dd3559'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:15 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.68a68695-21a2-487c-8162-f340db4747c6" returned: 0 in 0.300s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-68a68695-21a2-487c-8162-f340db4747c6" released by "_delete_snapshot" :: held 2.440s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" released by "delete_snapshot" :: held 2.500s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:15 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:15 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Created reservations ['94bff7cb-6707-43c3-aba7-e0b5b82b0750', 'd2f601fe-464b-4d2c-8026-4a357d45950b', '093eb415-4fa3-4f4b-86fe-c8e957d862e0', '91378e1f-a396-44fc-a2f7-eb089b7d9f68'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:15 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Delete snapshot completed successfully. Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-40845f9d-29f1-4e94-8d9a-8a40a3169c3b tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-68a68695-21a2-487c-8162-f340db4747c6-delete_snapshot" released by "delete_snapshot" :: held 2.753s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:15 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.354s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:15 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Deleted volume successfully. Sep 05 04:43:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-125e9241-1488-4e0b-a338-1b71edfef05f tempest-VolumeQuotasAdminTestJSON-88035933 None] Lock "cinder-519fa136-41a5-456e-be39-83ba2faeacde-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-21b10c04-4227-4bd4-8010-4c15324c9d03-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-21b10c04-4227-4bd4-8010-4c15324c9d03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-quobyte-21b10c04-4227-4bd4-8010-4c15324c9d03" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-e5f3a105-e220-4c12-91eb-887467b62feb req-202fcd26-f879-4609-a241-3086329a9df8 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-e5f3a105-e220-4c12-91eb-887467b62feb req-202fcd26-f879-4609-a241-3086329a9df8 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-e5f3a105-e220-4c12-91eb-887467b62feb req-202fcd26-f879-4609-a241-3086329a9df8 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-21b10c04-4227-4bd4-8010-4c15324c9d03" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Deleting offline snapshot 21b10c04-4227-4bd4-8010-4c15324c9d03 of volume 5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] snapshot_file for this snap is: volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[95db3a26-7d7a-44b1-82b3-a13ec5d6f2d0]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-e5f3a105-e220-4c12-91eb-887467b62feb req-202fcd26-f879-4609-a241-3086329a9df8 tempest-ServerActionsTestOtherA-289008059 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02f087d8-8240-40e7-9a5b-a269eb405174', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:43:16 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-e5f3a105-e220-4c12-91eb-887467b62feb req-202fcd26-f879-4609-a241-3086329a9df8 tempest-ServerActionsTestOtherA-289008059 None] attachment_update completed successfully. Sep 05 04:43:16 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 Sep 05 04:43:16 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:16 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03" returned: 0 in 0.519s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5809a8fd-f5f9-45f0-8384-01baff96846c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34df4e5-179e-4c26-af98-9c81b3b9b0f1]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:17 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c Sep 05 04:43:17 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:17 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2" returned: 0 in 2.478s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_odr03sildevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:43:17 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Converted 112.00 MB image at 45.17 MB/s Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:17 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 1G Sep 05 04:43:17 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:17 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c" returned: 0 in 0.739s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:17 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 Sep 05 04:43:17 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:17 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 1G" returned: 0 in 0.695s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Downloaded image d96433d1-6b83-48c1-88e8-5f747cd5fb19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}])) to volume 0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 successfully. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Temporary image d96433d1-6b83-48c1-88e8-5f747cd5fb19 for user 0be005456fc94100b2ae81bcaae1f770 is deleted. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Marking volume 0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 as bootable. {{(pid=89807) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Copying metadata from image d96433d1-6b83-48c1-88e8-5f747cd5fb19 to 0e28c7c9-ae02-42ea-848e-896ec5b9a4a2. {{(pid=89807) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 04:43:17 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Creating volume glance metadata for volume 0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 backed by image d96433d1-6b83-48c1-88e8-5f747cd5fb19 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89807) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82292d8f-5f29-4cf7-b03b-35e809fb2797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fb4cf7-240a-4240-bf31-051a67b8b81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:18 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Volume volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 (0e28c7c9-ae02-42ea-848e-896ec5b9a4a2): created successfully Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fb4cf7-240a-4240-bf31-051a67b8b81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Flow 'volume_create_manager' (c8ecc8a5-9527-4263-b1ce-39a586647374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:18 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6e85f8a5-0e9c-4550-9b8f-b890bfab6b73 tempest-VolumesExtendTest-270243796 None] Created volume successfully. Sep 05 04:43:18 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03" returned: 0 in 0.618s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:18 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03 Sep 05 04:43:18 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:18 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c.21b10c04-4227-4bd4-8010-4c15324c9d03" returned: 0 in 0.311s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-21b10c04-4227-4bd4-8010-4c15324c9d03" released by "_delete_snapshot" :: held 2.360s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" released by "delete_snapshot" :: held 2.412s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Created reservations ['cb9bfc57-e050-4486-8b19-4129e4ca7a82', 'f2b26603-28cf-4747-8822-4add41f50abc', '5a36d398-c89c-42f2-ac42-51e204340b5c', '098fc539-8465-4bc6-a0ff-8ffa7f84063f'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:18 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Delete snapshot completed successfully. Sep 05 04:43:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-400ee5a3-904c-4b64-9c87-82c1ab840bb0 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-21b10c04-4227-4bd4-8010-4c15324c9d03-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6250dcb9-3a18-4c30-8688-ac2cdacef0c3 tempest-VolumesExtendTest-270243796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6250dcb9-3a18-4c30-8688-ac2cdacef0c3 tempest-VolumesExtendTest-270243796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:19 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc559ddb-75cc-4c6a-9b78-d80c617225c2]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6250dcb9-3a18-4c30-8688-ac2cdacef0c3 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:19 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 Sep 05 04:43:19 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-5809a8fd-f5f9-45f0-8384-01baff96846c-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-5809a8fd-f5f9-45f0-8384-01baff96846c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:19 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6250dcb9-3a18-4c30-8688-ac2cdacef0c3 tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2" returned: 0 in 0.579s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6250dcb9-3a18-4c30-8688-ac2cdacef0c3 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 2G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:20 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81c1b6e-cd8f-4735-a50d-15a19a4929d6]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6250dcb9-3a18-4c30-8688-ac2cdacef0c3 tempest-VolumesExtendTest-270243796 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 2G" returned: 0 in 0.198s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6250dcb9-3a18-4c30-8688-ac2cdacef0c3 tempest-VolumesExtendTest-270243796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.852s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:20 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c Sep 05 04:43:20 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:20 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6250dcb9-3a18-4c30-8688-ac2cdacef0c3 tempest-VolumesExtendTest-270243796 None] Extend volume completed successfully. Sep 05 04:43:21 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c" returned: 0 in 0.999s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:21 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c Sep 05 04:43:21 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Acquiring lock "cinder-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Lock "cinder-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Acquiring lock "cinder-quobyte-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Lock "cinder-quobyte-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[264e30d6-1a79-4119-9db0-c53841c52814]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:21 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 Sep 05 04:43:21 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:21 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5809a8fd-f5f9-45f0-8384-01baff96846c" returned: 0 in 0.577s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-quobyte-5809a8fd-f5f9-45f0-8384-01baff96846c" released by "delete_volume" :: held 1.663s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Created reservations ['d0388558-2188-4e4e-b94e-8205135d3d3e', 'fba35f25-055a-4114-88c0-f633cdf5bd81', '976d81e0-2277-4719-a30a-854f9ba99e7d', 'eeed09db-4d09-4f09-b719-1f046e60c891'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:21 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:21 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:22 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2" returned: 0 in 0.630s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:22 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2 Sep 05 04:43:22 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:22 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.757s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:22 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:22 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Deleted volume successfully. Sep 05 04:43:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8b1a9773-8086-4db9-90d7-87cc92112f96 tempest-VolumesSnapshotListTestJSON-695335607 None] Lock "cinder-5809a8fd-f5f9-45f0-8384-01baff96846c-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:22 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2" returned: 0 in 0.689s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Lock "cinder-quobyte-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2" released by "delete_volume" :: held 1.399s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:22 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Created reservations ['90623fe0-92a3-4866-acba-80232f13a716', '9fd9ce87-fe00-49ad-8302-1abf1fb3b16b', '025f645e-0b68-4f99-a705-c153a4af466e', '80b230e6-efe9-4bbf-960a-ef02a3714d75'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:23 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:23 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:23 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.392s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:23 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:23 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Deleted volume successfully. Sep 05 04:43:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-847af6a9-de4f-45bf-8bc1-58de9257b734 tempest-VolumesExtendTest-270243796 None] Lock "cinder-0e28c7c9-ae02-42ea-848e-896ec5b9a4a2-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Flow 'volume_create_manager' (276a2f2f-b645-4052-983f-78b6cd0882b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b7baf8-51c5-4edb-bd73-470b5a9875c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b7baf8-51c5-4edb-bd73-470b5a9875c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2049964709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e137ec26-517e-40bd-8871-81501b7aa77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0ddc6c56094a76a284aa5ebc29aeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:25Z,use_quota=True,user_id='0be005456fc94100b2ae81bcaae1f770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06ab88b-90a9-486f-b262-27a184f5e53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06ab88b-90a9-486f-b262-27a184f5e53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb3f489-1ae7-437a-a806-580ccd414599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb3f489-1ae7-437a-a806-580ccd414599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e137ec26-517e-40bd-8871-81501b7aa77f', 'volume_name': 'volume-e137ec26-517e-40bd-8871-81501b7aa77f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5029e5-a625-4758-a47d-e0e869f93940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5029e5-a625-4758-a47d-e0e869f93940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ac5db0-e280-4c7c-9ac8-d6f9419e6e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:24 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Volume e137ec26-517e-40bd-8871-81501b7aa77f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e137ec26-517e-40bd-8871-81501b7aa77f', 'volume_size': 1} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2049964709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e137ec26-517e-40bd-8871-81501b7aa77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0ddc6c56094a76a284aa5ebc29aeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:25Z,use_quota=True,user_id='0be005456fc94100b2ae81bcaae1f770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Creating volume e137ec26-517e-40bd-8871-81501b7aa77f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:43:24 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:43:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:24 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f 1073741824 Sep 05 04:43:24 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:25 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f 1073741824" returned: 0 in 0.810s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:25 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f Sep 05 04:43:25 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:25 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f" returned: 0 in 0.318s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:43:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ac5db0-e280-4c7c-9ac8-d6f9419e6e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e137ec26-517e-40bd-8871-81501b7aa77f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0eb69e-a924-4df1-b1af-3ddca6edd1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:25 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Volume volume-e137ec26-517e-40bd-8871-81501b7aa77f (e137ec26-517e-40bd-8871-81501b7aa77f): created successfully Sep 05 04:43:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0eb69e-a924-4df1-b1af-3ddca6edd1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Flow 'volume_create_manager' (276a2f2f-b645-4052-983f-78b6cd0882b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:26 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9a4bdd6d-8d09-4357-8141-d4d7e0faa59c tempest-VolumesExtendTest-270243796 None] Created volume successfully. Sep 05 04:43:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Creating offline snapshot 854cb92d-9a2f-47c3-b0d0-f261a4d127d0 of volume e137ec26-517e-40bd-8871-81501b7aa77f {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:43:27 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[82af6874-dd96-436e-8c63-e8b3d782c9b5]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:27 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f Sep 05 04:43:27 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:27 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f" returned: 0 in 0.466s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:27 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 1G Sep 05 04:43:27 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:28 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 1G" returned: 0 in 0.574s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e137ec26-517e-40bd-8871-81501b7aa77f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:28 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e137ec26-517e-40bd-8871-81501b7aa77f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 Sep 05 04:43:28 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:28 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e137ec26-517e-40bd-8871-81501b7aa77f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0" returned: 0 in 0.412s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:28 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 is being set with open permissions: ugo+rw Sep 05 04:43:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:28 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 Sep 05 04:43:28 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:28 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0" returned: 0 in 0.297s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:28 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.info Sep 05 04:43:28 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:29 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Flow 'volume_create_manager' (d55e03fe-693b-4882-a25d-7ee87d34fd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9735af4c-fb60-4fdd-9335-7eb25925c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.info" returned: 0 in 0.427s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:29 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.info is being set with open permissions: ugo+rw Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9735af4c-fb60-4fdd-9335-7eb25925c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1713126189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a04c43cb0ad46ed94297ef63153fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:29Z,use_quota=True,user_id='38e7e3ab000d461ab5885a34ba2bf7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66268739-e554-4170-b526-9a85fa7aacdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66268739-e554-4170-b526-9a85fa7aacdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:29 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.info Sep 05 04:43:29 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b62bfe5-ee95-47ca-85a2-db90c4ec0c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b62bfe5-ee95-47ca-85a2-db90c4ec0c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f', 'volume_name': 'volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17336dd7-bc1f-46a3-9676-90c4f0c0babd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17336dd7-bc1f-46a3-9676-90c4f0c0babd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876d34bf-5b60-4766-9385-9d29cafc30ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Volume baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f', 'volume_size': 1} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Flow 'volume_create_manager' (8a132262-2923-4b03-b9db-ad8ba36b3677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e80394-13c0-449a-97a3-e0448519c476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e80394-13c0-449a-97a3-e0448519c476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1981169210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f4a50b-304d-4058-b67c-5c727f1b4719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c17a88d2804f2eb40ef183a4b596b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:29Z,use_quota=True,user_id='bccfb7e6c138492e932dd7d5807483d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc43c8e-200b-4572-bfa4-0986b7042e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc43c8e-200b-4572-bfa4-0986b7042e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25d1299-e725-4398-b1e6-b9a7aea0a30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25d1299-e725-4398-b1e6-b9a7aea0a30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f4a50b-304d-4058-b67c-5c727f1b4719', 'volume_name': 'volume-64f4a50b-304d-4058-b67c-5c727f1b4719', 'volume_size': 2}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80297c1-78ca-4b48-b02b-5388f7f6db35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80297c1-78ca-4b48-b02b-5388f7f6db35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d5b0cd-5be2-4324-b727-e9f8442e2299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Volume 64f4a50b-304d-4058-b67c-5c727f1b4719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f4a50b-304d-4058-b67c-5c727f1b4719', 'volume_size': 2} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:29 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.info" returned: 0 in 0.301s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.591s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1713126189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a04c43cb0ad46ed94297ef63153fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:29Z,use_quota=True,user_id='38e7e3ab000d461ab5885a34ba2bf7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Creating volume baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:43:29 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:29 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f 1073741824 Sep 05 04:43:29 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c82f4860-30b2-4ac4-8a8c-3105bf432ede tempest-VolumesExtendTest-270243796 None] Create snapshot completed successfully Sep 05 04:43:29 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f 1073741824" returned: 0 in 0.423s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:30 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f Sep 05 04:43:30 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-81705ed2-f9fe-4e10-9b87-967e34605a57 tempest-VolumesExtendTest-270243796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:30 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f" returned: 0 in 0.315s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1981169210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f4a50b-304d-4058-b67c-5c727f1b4719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c17a88d2804f2eb40ef183a4b596b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:29Z,use_quota=True,user_id='bccfb7e6c138492e932dd7d5807483d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Creating volume 64f4a50b-304d-4058-b67c-5c727f1b4719 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:43:30 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 2147483648 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876d34bf-5b60-4766-9385-9d29cafc30ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:30 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 2147483648 Sep 05 04:43:30 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb915a2b-30d2-4836-93d2-29264308138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Volume volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f (baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f): created successfully Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb915a2b-30d2-4836-93d2-29264308138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Flow 'volume_create_manager' (d55e03fe-693b-4882-a25d-7ee87d34fd7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f5845ed6-de21-44a7-b882-b7d5048f19bf tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Created volume successfully. Sep 05 04:43:30 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 2147483648" returned: 0 in 0.462s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:30 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 Sep 05 04:43:30 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:31 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719" returned: 0 in 0.243s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-81705ed2-f9fe-4e10-9b87-967e34605a57 tempest-VolumesExtendTest-270243796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.821s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d5b0cd-5be2-4324-b727-e9f8442e2299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f4a50b-304d-4058-b67c-5c727f1b4719', 'volume_size': 2}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc9809f-8035-4b46-a305-9a527c3faaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5ade5f-9f6e-4718-9cee-839e69f3434c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-81705ed2-f9fe-4e10-9b87-967e34605a57 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:31 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Volume volume-64f4a50b-304d-4058-b67c-5c727f1b4719 (64f4a50b-304d-4058-b67c-5c727f1b4719): created successfully Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc9809f-8035-4b46-a305-9a527c3faaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Flow 'volume_create_manager' (8a132262-2923-4b03-b9db-ad8ba36b3677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:31 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c9d1eb83-f43b-4dd6-95c0-6ecbdae61b4e tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Created volume successfully. Sep 05 04:43:31 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f Sep 05 04:43:31 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:31 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-81705ed2-f9fe-4e10-9b87-967e34605a57 tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f" returned: 0 in 0.426s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-81705ed2-f9fe-4e10-9b87-967e34605a57 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 2G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-81705ed2-f9fe-4e10-9b87-967e34605a57 tempest-VolumesExtendTest-270243796 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 2G" returned: 0 in 0.185s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-81705ed2-f9fe-4e10-9b87-967e34605a57 tempest-VolumesExtendTest-270243796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.679s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Creating offline snapshot 02b6710f-6a25-45d4-95b0-7f741acf661d of volume 64f4a50b-304d-4058-b67c-5c727f1b4719 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:43:31 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-81705ed2-f9fe-4e10-9b87-967e34605a57 tempest-VolumesExtendTest-270243796 None] Extend volume completed successfully. Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e584b12-d698-47de-949a-5c258d371409]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:31 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 Sep 05 04:43:31 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:32 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719" returned: 0 in 0.417s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d 2G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:32 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d 2G Sep 05 04:43:32 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Acquiring lock "cinder-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Lock "cinder-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Acquiring lock "cinder-quobyte-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Lock "cinder-quobyte-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5bad4a-afc9-43f8-aa14-658f30c0b0d7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Acquiring lock "cinder-854cb92d-9a2f-47c3-b0d0-f261a4d127d0-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Lock "cinder-854cb92d-9a2f-47c3-b0d0-f261a4d127d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Acquiring lock "cinder-quobyte-e137ec26-517e-40bd-8871-81501b7aa77f" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Lock "cinder-quobyte-e137ec26-517e-40bd-8871-81501b7aa77f" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Acquiring lock "cinder-quobyte-854cb92d-9a2f-47c3-b0d0-f261a4d127d0" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:32 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f Sep 05 04:43:32 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Lock "cinder-quobyte-854cb92d-9a2f-47c3-b0d0-f261a4d127d0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Deleting offline snapshot 854cb92d-9a2f-47c3-b0d0-f261a4d127d0 of volume e137ec26-517e-40bd-8871-81501b7aa77f {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] snapshot_file for this snap is: volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cea50c-a82f-4269-89d5-ab74ebcb8d6c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:32 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d 2G" returned: 0 in 0.577s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64f4a50b-304d-4058-b67c-5c727f1b4719 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:32 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64f4a50b-304d-4058-b67c-5c727f1b4719 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d Sep 05 04:43:32 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:32 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 Sep 05 04:43:32 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:33 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f" returned: 0 in 0.471s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:33 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f Sep 05 04:43:33 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:33 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64f4a50b-304d-4058-b67c-5c727f1b4719 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d" returned: 0 in 0.382s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:33 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d is being set with open permissions: ugo+rw Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:33 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0" returned: 0 in 0.420s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e137ec26-517e-40bd-8871-81501b7aa77f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:43:33 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d Sep 05 04:43:33 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ebec12-5b58-4dd2-9a03-34157261c3f4]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:33 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f" returned: 0 in 0.338s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:33 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f Sep 05 04:43:33 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Lock "cinder-quobyte-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f" released by "delete_volume" :: held 0.865s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=162,cinder:SELECT=141,cinder:INSERT=49,cinder:DELETE=15 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:43:33 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d" returned: 0 in 0.266s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Created reservations ['0925a01e-e842-4bc3-8ac2-9e376517960c', '6c4f023f-35c7-4750-8a26-fa2d5d2b135b', '489e0cf7-4da6-4a15-af4e-ab74676d7348', '1cc48c86-069a-4b2a-b006-7d091d1ec4b4'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:33 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.info Sep 05 04:43:33 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:33 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:33 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:33 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f" returned: 0 in 0.627s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:33 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.info" returned: 0 in 0.411s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:33 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.info is being set with open permissions: ugo+rw Sep 05 04:43:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:33 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 Sep 05 04:43:33 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:34 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.info Sep 05 04:43:34 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:34 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.509s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:34 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Deleted volume successfully. Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-55cfb5b0-f5b8-4c7d-9f74-1ed3dc25b60b tempest-VolumeQuotasNegativeTestJSON-2141085281 None] Lock "cinder-baa1b2c5-b8e8-458b-9c46-fe4a99cdbc6f-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:34 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.info" returned: 0 in 0.414s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.591s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:34 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c38fe3e4-071c-462d-aa03-96294bfaac36 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Create snapshot completed successfully Sep 05 04:43:34 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0" returned: 0 in 0.566s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:34 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0 Sep 05 04:43:34 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:34 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f.854cb92d-9a2f-47c3-b0d0-f261a4d127d0" returned: 0 in 0.292s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Lock "cinder-quobyte-854cb92d-9a2f-47c3-b0d0-f261a4d127d0" released by "_delete_snapshot" :: held 2.051s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Lock "cinder-quobyte-e137ec26-517e-40bd-8871-81501b7aa77f" released by "delete_snapshot" :: held 2.089s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:34 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Created reservations ['8de3ed6b-533d-4937-bf65-c94a92ce4f00', '59579389-a25e-4e11-8a6c-f8bc79f3295b', '51c24b1f-8b28-4842-b31c-16cd825d100c', 'df5cecb5-0d9d-421c-9f7f-61f49d634b2a'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Delete snapshot completed successfully. Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-635c39e9-58e6-4209-8ce2-66bed5d5f67e tempest-VolumesExtendTest-270243796 None] Lock "cinder-854cb92d-9a2f-47c3-b0d0-f261a4d127d0-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Acquiring lock "cinder-02b6710f-6a25-45d4-95b0-7f741acf661d-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "cinder-02b6710f-6a25-45d4-95b0-7f741acf661d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Acquiring lock "cinder-quobyte-64f4a50b-304d-4058-b67c-5c727f1b4719" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "cinder-quobyte-64f4a50b-304d-4058-b67c-5c727f1b4719" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Acquiring lock "cinder-quobyte-02b6710f-6a25-45d4-95b0-7f741acf661d" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "cinder-quobyte-02b6710f-6a25-45d4-95b0-7f741acf661d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Deleting offline snapshot 02b6710f-6a25-45d4-95b0-7f741acf661d of volume 64f4a50b-304d-4058-b67c-5c727f1b4719 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] snapshot_file for this snap is: volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[544496fb-970f-4b61-88eb-602a2e76f081]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:35 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d Sep 05 04:43:35 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:35 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d" returned: 0 in 0.423s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64f4a50b-304d-4058-b67c-5c727f1b4719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[625a172a-4c8b-4d01-9ac1-cbbe1e2c653d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:35 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 Sep 05 04:43:35 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Acquiring lock "cinder-e137ec26-517e-40bd-8871-81501b7aa77f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Lock "cinder-e137ec26-517e-40bd-8871-81501b7aa77f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Acquiring lock "cinder-quobyte-e137ec26-517e-40bd-8871-81501b7aa77f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Lock "cinder-quobyte-e137ec26-517e-40bd-8871-81501b7aa77f" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:36 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719" returned: 0 in 0.499s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6847ad1-e7c6-4b64-9fa8-6a43b3e5d246]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:36 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d Sep 05 04:43:36 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:36 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f Sep 05 04:43:36 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:36 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d" returned: 0 in 0.459s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:36 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d Sep 05 04:43:36 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:36 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f" returned: 0 in 0.530s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:36 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f Sep 05 04:43:36 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:36 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719.02b6710f-6a25-45d4-95b0-7f741acf661d" returned: 0 in 0.296s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "cinder-quobyte-02b6710f-6a25-45d4-95b0-7f741acf661d" released by "_delete_snapshot" :: held 1.862s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "cinder-quobyte-64f4a50b-304d-4058-b67c-5c727f1b4719" released by "delete_snapshot" :: held 1.889s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:37 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e137ec26-517e-40bd-8871-81501b7aa77f" returned: 0 in 0.296s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Lock "cinder-quobyte-e137ec26-517e-40bd-8871-81501b7aa77f" released by "delete_volume" :: held 0.942s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Created reservations ['d745f90f-1b67-4a55-b28b-e1abc66c8f76', '204b50fe-eb3e-4278-9da2-99feaf49fe1b', 'b903d7b2-0933-4dc9-960d-0ab8d562afea', '8eec4030-f505-411c-8188-d37b4e6aba8d'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Created reservations ['b2c36bd5-48d3-4ab7-8239-1e2a2593d946', '6e39d193-b110-4155-8947-85c2365e57f7', 'fad7b0f6-3786-4d56-9a01-d1b74477a2b4', '0cf310af-7458-475f-bac1-4084b99d4a97'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Delete snapshot completed successfully. Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b2af6090-be6b-464a-b487-5c7baaa6f380 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "cinder-02b6710f-6a25-45d4-95b0-7f741acf661d-delete_snapshot" released by "delete_snapshot" :: held 2.152s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:37 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:37 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Acquiring lock "cinder-64f4a50b-304d-4058-b67c-5c727f1b4719-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "cinder-64f4a50b-304d-4058-b67c-5c727f1b4719-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Acquiring lock "cinder-quobyte-64f4a50b-304d-4058-b67c-5c727f1b4719" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "cinder-quobyte-64f4a50b-304d-4058-b67c-5c727f1b4719" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f643e30e-0fa5-47bc-925a-75f379674b53]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:37 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.281s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Deleted volume successfully. Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c0215135-dfb0-4a28-8c9e-b4f78359eaa1 tempest-VolumesExtendTest-270243796 None] Lock "cinder-e137ec26-517e-40bd-8871-81501b7aa77f-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:37 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 Sep 05 04:43:37 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:37 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:37 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719 Sep 05 04:43:37 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:38 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-64f4a50b-304d-4058-b67c-5c727f1b4719" returned: 0 in 0.261s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "cinder-quobyte-64f4a50b-304d-4058-b67c-5c727f1b4719" released by "delete_volume" :: held 0.717s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Created reservations ['b03838c3-2355-4eaa-877f-ca7fc2cb2530', '12a8f0a2-6934-4000-bce0-5b16c3c39871', 'c32458ca-5bf6-4e57-91d2-0ccf90098d7f', '9b5b4c16-93e6-4b52-89e2-7cc105981316'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:38 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:38 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:38 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.271s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:38 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Deleted volume successfully. Sep 05 04:43:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ce1aef55-fd92-45bc-ab37-4c38611320a7 tempest-VolumesSnapshotNegativeTestJSON-1152495757 None] Lock "cinder-64f4a50b-304d-4058-b67c-5c727f1b4719-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Flow 'volume_create_manager' (bb0cd4af-6384-49f8-ba65-47f2ebcc985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c81ca0b-1852-43fa-b22b-f6731ef1a146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c81ca0b-1852-43fa-b22b-f6731ef1a146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-419352298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5793f6-7865-4ca2-88d1-1a7c98c168bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b124e8811dc445bdbc8c72fd12d8600b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:43Z,use_quota=True,user_id='61a4b6a0ecab4602bc85e5fa0ac2d7d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4b3e85c-f833-4f64-a826-e7cc506f6e01),volume_type_id=e4b3e85c-f833-4f64-a826-e7cc506f6e01)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ce4c49-c65f-488c-b045-3ae0227096cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ce4c49-c65f-488c-b045-3ae0227096cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b736e6f3-0050-43cc-8d4f-aed3ca0e91cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b736e6f3-0050-43cc-8d4f-aed3ca0e91cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5793f6-7865-4ca2-88d1-1a7c98c168bc', 'volume_name': 'volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8384ff6-2b36-4b10-b172-aa9e2a0902c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8384ff6-2b36-4b10-b172-aa9e2a0902c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0f33d9-4319-4c2b-96b0-d517005c30c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Volume ae5793f6-7865-4ca2-88d1-1a7c98c168bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc', 'volume_size': 1} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-419352298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5793f6-7865-4ca2-88d1-1a7c98c168bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b124e8811dc445bdbc8c72fd12d8600b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:43Z,use_quota=True,user_id='61a4b6a0ecab4602bc85e5fa0ac2d7d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4b3e85c-f833-4f64-a826-e7cc506f6e01),volume_type_id=e4b3e85c-f833-4f64-a826-e7cc506f6e01)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Creating volume ae5793f6-7865-4ca2-88d1-1a7c98c168bc {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:43:42 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:43:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:43 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc 1073741824 Sep 05 04:43:43 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (b0e8f954-31c5-4e40-ac06-4d023729d593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52786696-38c2-44fc-88c2-8c38eb740a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52786696-38c2-44fc-88c2-8c38eb740a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-488601084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a907ed-286a-42a2-bdd4-9c2f7f500551,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:44Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaa0494-d5b8-4298-be21-7b928511db9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaa0494-d5b8-4298-be21-7b928511db9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0785051-3dfc-479f-8b44-97d7c136225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0785051-3dfc-479f-8b44-97d7c136225b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a907ed-286a-42a2-bdd4-9c2f7f500551', 'volume_name': 'volume-38a907ed-286a-42a2-bdd4-9c2f7f500551', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127e6e03-5424-426b-a370-b0b3826932ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127e6e03-5424-426b-a370-b0b3826932ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73937852-19d4-4b8b-bd93-d0acfd1ce879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:43 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Volume 38a907ed-286a-42a2-bdd4-9c2f7f500551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a907ed-286a-42a2-bdd4-9c2f7f500551', 'volume_size': 1} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:43 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc 1073741824" returned: 0 in 0.742s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:43 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc Sep 05 04:43:43 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:44 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc" returned: 0 in 0.290s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-488601084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a907ed-286a-42a2-bdd4-9c2f7f500551,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:44Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Creating volume 38a907ed-286a-42a2-bdd4-9c2f7f500551 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:43:44 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0f33d9-4319-4c2b-96b0-d517005c30c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44553ce8-076b-47c4-8f9d-4229e0751f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:44 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551 1073741824 Sep 05 04:43:44 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:44 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Volume volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc (ae5793f6-7865-4ca2-88d1-1a7c98c168bc): created successfully Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44553ce8-076b-47c4-8f9d-4229e0751f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Flow 'volume_create_manager' (bb0cd4af-6384-49f8-ba65-47f2ebcc985f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4f49865b-8fa3-4ae8-8cd5-248dbef062c4 tempest-VolumeTypesAccessTest-1341257147 None] Created volume successfully. Sep 05 04:43:44 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551 1073741824" returned: 0 in 0.529s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:44 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551 Sep 05 04:43:44 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:44 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551" returned: 0 in 0.285s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73937852-19d4-4b8b-bd93-d0acfd1ce879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a907ed-286a-42a2-bdd4-9c2f7f500551', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c9a8bd-da3c-4e0e-af25-4a8257a14128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:44 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Volume volume-38a907ed-286a-42a2-bdd4-9c2f7f500551 (38a907ed-286a-42a2-bdd4-9c2f7f500551): created successfully Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c9a8bd-da3c-4e0e-af25-4a8257a14128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (b0e8f954-31c5-4e40-ac06-4d023729d593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-708d9fec-b64a-42c2-87f6-8cbff7cc11e2 tempest-VolumesGetTest-1624282460 None] Created volume successfully. Sep 05 04:43:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Acquiring lock "cinder-ae5793f6-7865-4ca2-88d1-1a7c98c168bc-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Lock "cinder-ae5793f6-7865-4ca2-88d1-1a7c98c168bc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Acquiring lock "cinder-quobyte-ae5793f6-7865-4ca2-88d1-1a7c98c168bc" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Lock "cinder-quobyte-ae5793f6-7865-4ca2-88d1-1a7c98c168bc" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:45 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[07261e7c-6074-439a-8703-2a4d3e47eccc]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:45 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc Sep 05 04:43:45 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:45 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc" returned: 0 in 0.490s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:45 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc Sep 05 04:43:45 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:46 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ae5793f6-7865-4ca2-88d1-1a7c98c168bc" returned: 0 in 0.451s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Lock "cinder-quobyte-ae5793f6-7865-4ca2-88d1-1a7c98c168bc" released by "delete_volume" :: held 1.001s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:46 devstack cinder-volume[89807]: WARNING cinder.quota [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1234846671 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1234846671, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:43:46 devstack cinder-volume[89807]: WARNING cinder.quota [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1234846671 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1234846671, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:43:46 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Created reservations ['097d2c12-d846-4268-8873-1d32086119b0', '2e9074ca-e1d8-4ffe-9506-2ea0f6b66f0d', '1e6dcda8-e652-4e01-aeda-cacdac5c634c', '51ff5762-30e9-420a-b2b5-831d8a8e7668'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:46 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:46 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:47 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (b17ac50f-96d4-4fc8-b435-baff0c3a0325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467616e4-0244-494b-a09d-6c47af0d1ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.515s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:47 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Deleted volume successfully. Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467616e4-0244-494b-a09d-6c47af0d1ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1287711713',display_name='tempest-VolumesGetTest-Volume-150483782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201fd793-3e52-4b30-92b1-81f44449fdb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:47Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411952a3-c4a6-4302-9737-c06bb853e9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411952a3-c4a6-4302-9737-c06bb853e9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7fbdc1-60a9-42da-8dd7-37b4890b4ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7fbdc1-60a9-42da-8dd7-37b4890b4ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201fd793-3e52-4b30-92b1-81f44449fdb7', 'volume_name': 'volume-201fd793-3e52-4b30-92b1-81f44449fdb7', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0500ad85-07fe-447e-aa63-9a1f4787638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0500ad85-07fe-447e-aa63-9a1f4787638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29646ed3-9e3c-46dc-b79c-241a745701ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:47 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Volume 201fd793-3e52-4b30-92b1-81f44449fdb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201fd793-3e52-4b30-92b1-81f44449fdb7', 'volume_size': 1} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1287711713',display_name='tempest-VolumesGetTest-Volume-150483782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201fd793-3e52-4b30-92b1-81f44449fdb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:47Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Creating volume 201fd793-3e52-4b30-92b1-81f44449fdb7 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:43:47 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:47 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7 1073741824 Sep 05 04:43:47 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-16bb1676-142c-4f93-9c54-58df833d6c7f tempest-VolumeTypesAccessTest-1341257147 None] Lock "cinder-ae5793f6-7865-4ca2-88d1-1a7c98c168bc-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:47 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7 1073741824" returned: 0 in 0.631s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:47 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7 Sep 05 04:43:47 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:48 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7" returned: 0 in 0.298s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29646ed3-9e3c-46dc-b79c-241a745701ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201fd793-3e52-4b30-92b1-81f44449fdb7', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec83b553-5342-4673-9862-1114a7bea357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:48 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Volume volume-201fd793-3e52-4b30-92b1-81f44449fdb7 (201fd793-3e52-4b30-92b1-81f44449fdb7): created successfully Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec83b553-5342-4673-9862-1114a7bea357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (b17ac50f-96d4-4fc8-b435-baff0c3a0325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9103007b-810c-4d36-8cdb-01aab7d88c4d tempest-VolumesGetTest-1624282460 None] Created volume successfully. Sep 05 04:43:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e40b8346-6a02-4a34-8b6f-93c36a9c7432 tempest-ServerActionsTestOtherA-289008059 None] Terminate volume connection completed successfully. Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e40b8346-6a02-4a34-8b6f-93c36a9c7432 tempest-ServerActionsTestOtherA-289008059 None] Deleting attachment 02f087d8-8240-40e7-9a5b-a269eb405174. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "cinder-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Lock "cinder-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "cinder-quobyte-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Lock "cinder-quobyte-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95bd7b-1cd4-4ca6-9f17-8cf9e3fe994b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:49 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 Sep 05 04:43:49 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-201fd793-3e52-4b30-92b1-81f44449fdb7-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Lock "cinder-201fd793-3e52-4b30-92b1-81f44449fdb7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-quobyte-201fd793-3e52-4b30-92b1-81f44449fdb7" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-201fd793-3e52-4b30-92b1-81f44449fdb7" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:49 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2429a06c-b77f-4d17-8066-6fd9025583c4]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:49 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7" returned: 0 in 0.701s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:49 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7 Sep 05 04:43:49 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:49 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7 Sep 05 04:43:49 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "cinder-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Lock "cinder-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "cinder-quobyte-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Lock "cinder-quobyte-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[fded9cd4-9789-4fbc-ad3f-62f6372d1e76]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:50 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:50 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7" returned: 0 in 0.491s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Lock "cinder-quobyte-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7" released by "delete_volume" :: held 1.262s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7" returned: 0 in 0.572s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:50 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7 Sep 05 04:43:50 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:50 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf Sep 05 04:43:50 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.quota [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Created reservations ['14a186ae-6b7f-439a-8ab5-b13d0033aa33', '707586ff-a015-495b-a2d9-87c3d78027a2', '80726226-1a03-45c6-b790-6a9c6bc119f4', '24fdc7a9-b3c0-4524-a4ce-c356c7549d19'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:50 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:50 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:50 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-201fd793-3e52-4b30-92b1-81f44449fdb7" returned: 0 in 0.533s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-201fd793-3e52-4b30-92b1-81f44449fdb7" released by "delete_volume" :: held 1.166s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:50 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf" returned: 0 in 0.650s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:50 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf Sep 05 04:43:50 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Created reservations ['ae371c8d-15aa-4cfc-bf4f-54e0fe9825c6', '3c0e80c8-714d-46bf-a6ec-2f502cd61866', '5eba4e59-fecc-4802-b576-651a8091a53f', '03b1e6aa-8e85-4d94-a9b6-d3f006651e50'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:50 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.362s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.manager [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:50 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Deleted volume successfully. Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-b5cb0479-1ac2-4270-89a9-7d85f194461b req-e0457e5a-df52-4050-a0fb-bdf5d0f509d3 tempest-ServerActionsTestOtherA-289008059 None] Lock "cinder-94275fd3-88ed-4ecd-9985-f9c13e1f3ae7-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:50 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:50 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:51 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf" returned: 0 in 0.435s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Lock "cinder-quobyte-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf" released by "delete_volume" :: held 1.145s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Created reservations ['a4fb5de5-ac94-4b59-8bc8-be568919fd6e', 'ba76c520-f2aa-48dd-a3e7-78d37acea24f', 'dcab0c26-d511-4fa7-a770-587fe50ac599', '3b72d7b8-fbaa-46c1-a682-d2bf8b81f3cd'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:51 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.370s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:51 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Deleted volume successfully. Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-35d9538d-e213-4b77-b24b-e02bb4989d52 tempest-VolumesGetTest-1624282460 None] Lock "cinder-201fd793-3e52-4b30-92b1-81f44449fdb7-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:51 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:51 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:51 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.308s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:51 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Deleted volume successfully. Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-acc806af-7c24-4251-a5dc-5abbf5900c1e tempest-ServerActionsTestOtherA-289008059 None] Lock "cinder-d718e0f7-9eb0-4921-84a0-3d406a1ab7bf-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-38a907ed-286a-42a2-bdd4-9c2f7f500551-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Lock "cinder-38a907ed-286a-42a2-bdd4-9c2f7f500551-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-quobyte-38a907ed-286a-42a2-bdd4-9c2f7f500551" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:43:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-38a907ed-286a-42a2-bdd4-9c2f7f500551" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:43:52 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[859fd57a-7d5e-4837-876a-7bf824816674]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:52 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551 Sep 05 04:43:52 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:52 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551" returned: 0 in 0.608s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:52 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551 Sep 05 04:43:52 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:53 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-38a907ed-286a-42a2-bdd4-9c2f7f500551" returned: 0 in 0.491s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-38a907ed-286a-42a2-bdd4-9c2f7f500551" released by "delete_volume" :: held 1.166s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=160,cinder:INSERT=45,cinder:UPDATE=174,cinder:DELETE=9 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Created reservations ['7568ac9d-88de-4902-9d86-71568029eaee', 'c75b8179-7fd5-4ada-8cd3-0d9fd842a629', '05d9107c-465d-4d54-993d-0df72c590ccc', '0165c401-4201-458f-8949-fb2071eda2f9'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:53 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:43:53 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:53 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.293s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:43:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Deleted volume successfully. Sep 05 04:43:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-26718355-6375-4d80-bdda-618562d3368c tempest-VolumesGetTest-1624282460 None] Lock "cinder-38a907ed-286a-42a2-bdd4-9c2f7f500551-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (6178a669-eca1-4b76-b393-9a92379564a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb68cfe-07e7-4872-8ba3-9d3797f436d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb68cfe-07e7-4872-8ba3-9d3797f436d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-210082865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7749e3-660b-4a3e-b61e-7f6043cbd893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:55Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c34b54-8df4-4e6f-9b81-07b185dd10c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c34b54-8df4-4e6f-9b81-07b185dd10c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2908dfbc-ac27-4244-ab2b-b48d27e2f42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2908dfbc-ac27-4244-ab2b-b48d27e2f42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7749e3-660b-4a3e-b61e-7f6043cbd893', 'volume_name': 'volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76958547-fe4f-46dc-bb42-d8536f6e94af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76958547-fe4f-46dc-bb42-d8536f6e94af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b80ebac-a50c-4086-84d4-54899efa2c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:55 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Volume fb7749e3-660b-4a3e-b61e-7f6043cbd893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893', 'volume_size': 1} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-210082865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7749e3-660b-4a3e-b61e-7f6043cbd893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:55Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Creating volume fb7749e3-660b-4a3e-b61e-7f6043cbd893 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:43:55 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:55 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 1073741824 Sep 05 04:43:55 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:55 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 1073741824" returned: 0 in 0.551s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:55 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 Sep 05 04:43:55 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:56 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893" returned: 0 in 0.363s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:43:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:43:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b80ebac-a50c-4086-84d4-54899efa2c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322db137-3438-4f98-bb90-e4d967400ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:56 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Volume volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 (fb7749e3-660b-4a3e-b61e-7f6043cbd893): created successfully Sep 05 04:43:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322db137-3438-4f98-bb90-e4d967400ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (6178a669-eca1-4b76-b393-9a92379564a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:56 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1d0013f3-18a7-44bd-8926-89972deb62c7 tempest-VolumesGetTest-1624282460 None] Created volume successfully. Sep 05 04:43:57 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:43:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (567adccd-570e-46b4-b37d-329f5ae51baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:43:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2b8c9a-d496-4fb6-a63c-ef002fb8769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2b8c9a-d496-4fb6-a63c-ef002fb8769f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-832905700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e854b28-ae7f-4894-9e4e-01824de99f99,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fb7749e3-660b-4a3e-b61e-7f6043cbd893,status='creating',terminated_at=None,updated_at=2026-09-05T02:43:58Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1394d42c-c89b-4d35-a39c-055debdc9e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1394d42c-c89b-4d35-a39c-055debdc9e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d5312a-d127-4a7d-8a7b-4c686a10900b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d5312a-d127-4a7d-8a7b-4c686a10900b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8e854b28-ae7f-4894-9e4e-01824de99f99', 'volume_name': 'volume-8e854b28-ae7f-4894-9e4e-01824de99f99', 'volume_size': 1, 'source_volid': 'fb7749e3-660b-4a3e-b61e-7f6043cbd893', 'source_volstatus': 'available'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36155b8-3c7c-41dc-930f-c692b3db93a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36155b8-3c7c-41dc-930f-c692b3db93a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8461ebc-5b17-4560-ba36-014a6d08d14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:43:58 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Volume 8e854b28-ae7f-4894-9e4e-01824de99f99: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8e854b28-ae7f-4894-9e4e-01824de99f99', 'volume_size': 1, 'source_volid': 'fb7749e3-660b-4a3e-b61e-7f6043cbd893', 'source_volstatus': 'available'} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:43:58 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Cloning volume fb7749e3-660b-4a3e-b61e-7f6043cbd893 to volume 8e854b28-ae7f-4894-9e4e-01824de99f99 Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Creating offline snapshot 166491b4-95b7-4280-a544-4d338f2d8605 of volume fb7749e3-660b-4a3e-b61e-7f6043cbd893 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f36f8-7660-44d2-9128-46c9e332c1c4]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:58 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 Sep 05 04:43:58 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:58 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893" returned: 0 in 0.505s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:58 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 1G Sep 05 04:43:58 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:59 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 1G" returned: 0 in 0.655s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:59 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 Sep 05 04:43:59 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:43:59 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 05 04:43:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605" returned: 0 in 0.401s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:43:59 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 is being set with open permissions: ugo+rw Sep 05 04:43:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:43:59 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 Sep 05 04:43:59 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:00 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605" returned: 0 in 0.401s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:00 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.info Sep 05 04:44:00 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:00 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.info" returned: 0 in 0.304s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:00 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.info is being set with open permissions: ugo+rw Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:00 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.info Sep 05 04:44:00 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:00 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.info" returned: 0 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-quobyte-8e854b28-ae7f-4894-9e4e-01824de99f99" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-8e854b28-ae7f-4894-9e4e-01824de99f99" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] snapshot: 166491b4-95b7-4280-a544-4d338f2d8605, volume: 8e854b28-ae7f-4894-9e4e-01824de99f99, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baa83a1-a110-46de-abb5-2005db380285]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:01 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 Sep 05 04:44:01 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:01 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605" returned: 0 in 0.493s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:44:01 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa35aba-e811-496a-af67-10d55bc4bad6]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:01 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 Sep 05 04:44:01 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:02 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893" returned: 0 in 0.589s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:02 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 Sep 05 04:44:02 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Flow 'volume_create_manager' (fadbf30a-8c38-4d03-a8ff-7fabac9075ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41eada9-bd7f-4a67-a648-ca49a9a07ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41eada9-bd7f-4a67-a648-ca49a9a07ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-221397991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4f23ae-b2ac-4446-95fc-2b4eede3004c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3d8b01754840ea9a398e4aea971772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:02Z,use_quota=True,user_id='74a646bb9fbb4ea2bb41253065f06557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73c030e-ea95-48d3-9187-845269e18f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73c030e-ea95-48d3-9187-845269e18f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c514cee7-68c5-4bd7-985e-0a871b2d6790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c514cee7-68c5-4bd7-985e-0a871b2d6790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4f23ae-b2ac-4446-95fc-2b4eede3004c', 'volume_name': 'volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb3ff39-5b8f-4baa-a4a7-ef31b78f14d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb3ff39-5b8f-4baa-a4a7-ef31b78f14d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065b6bb4-9641-4f1c-a530-ae2038a47491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:02 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Volume be4f23ae-b2ac-4446-95fc-2b4eede3004c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c', 'volume_size': 1} Sep 05 04:44:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99" returned: 0 in 6.060s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:44:08 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Converted 1024.00 MB image at 168.91 MB/s Sep 05 04:44:08 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 is being set with open permissions: ugo+rw Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:08 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 Sep 05 04:44:08 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:08 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99" returned: 0 in 0.287s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-8e854b28-ae7f-4894-9e4e-01824de99f99" released by "_copy_volume_from_snapshot" :: held 7.529s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-quobyte-166491b4-95b7-4280-a544-4d338f2d8605" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-166491b4-95b7-4280-a544-4d338f2d8605" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Deleting offline snapshot 166491b4-95b7-4280-a544-4d338f2d8605 of volume fb7749e3-660b-4a3e-b61e-7f6043cbd893 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] snapshot_file for this snap is: volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03b3bab-8d25-42a0-a406-59137f3cd884]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:08 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 Sep 05 04:44:08 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:08 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605" returned: 0 in 0.443s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d549bbc-b214-491e-a878-fd346c770ccf]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:09 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 Sep 05 04:44:09 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:09 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893" returned: 0 in 0.607s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:09 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 Sep 05 04:44:09 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:09 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605" returned: 0 in 0.408s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:10 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605 Sep 05 04:44:10 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:10 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893.166491b4-95b7-4280-a544-4d338f2d8605" returned: 0 in 0.310s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-166491b4-95b7-4280-a544-4d338f2d8605" released by "_delete_snapshot" :: held 1.884s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.327s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.055s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-221397991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4f23ae-b2ac-4446-95fc-2b4eede3004c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3d8b01754840ea9a398e4aea971772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:02Z,use_quota=True,user_id='74a646bb9fbb4ea2bb41253065f06557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Creating volume be4f23ae-b2ac-4446-95fc-2b4eede3004c {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:44:10 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8461ebc-5b17-4560-ba36-014a6d08d14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e854b28-ae7f-4894-9e4e-01824de99f99', 'volume_size': 1, 'source_volid': 'fb7749e3-660b-4a3e-b61e-7f6043cbd893', 'source_volstatus': 'available'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f2101a-8c30-4c56-aef1-31922c18df15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:10 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c 1073741824 Sep 05 04:44:10 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:10 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Volume volume-8e854b28-ae7f-4894-9e4e-01824de99f99 (8e854b28-ae7f-4894-9e4e-01824de99f99): created successfully Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f2101a-8c30-4c56-aef1-31922c18df15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (567adccd-570e-46b4-b37d-329f5ae51baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:10 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e8d509f0-35ae-4b19-8985-4dab6ba8dfce tempest-VolumesGetTest-1624282460 None] Created volume successfully. Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:10 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:44:10 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:10 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.341s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:44:11 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c 1073741824" returned: 0 in 0.602s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:11 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c Sep 05 04:44:11 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:11 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c" returned: 0 in 0.419s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065b6bb4-9641-4f1c-a530-ae2038a47491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88f1143-c817-4f2b-b735-e0eb94e6afa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:11 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Volume volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c (be4f23ae-b2ac-4446-95fc-2b4eede3004c): created successfully Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88f1143-c817-4f2b-b735-e0eb94e6afa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Flow 'volume_create_manager' (fadbf30a-8c38-4d03-a8ff-7fabac9075ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:11 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c5d77cd0-8975-4130-b0d6-3200c60d57dd tempest-SnapshotMetadataTestJSON-362443 None] Created volume successfully. Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (63b5286d-13d1-41fa-8649-94e42da7ff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea2ce43-4758-4697-89c8-90538f99c818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea2ce43-4758-4697-89c8-90538f99c818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1680083526',display_name='tempest-VolumesGetTest-Volume-808389177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8bb944-a308-4972-9209-d8fcd8ef3a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:12Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac7876a-1eef-4228-ad92-fb48154e1815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac7876a-1eef-4228-ad92-fb48154e1815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfe5545-e781-4cd5-9f71-9a083c1a64b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfe5545-e781-4cd5-9f71-9a083c1a64b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8bb944-a308-4972-9209-d8fcd8ef3a5a', 'volume_name': 'volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6a3dae-9e7b-4559-ac19-6da36e925fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6a3dae-9e7b-4559-ac19-6da36e925fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a02cc0c-b58e-41ad-8d71-62a9fd08b4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:12 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Volume df8bb944-a308-4972-9209-d8fcd8ef3a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a', 'volume_size': 1} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1680083526',display_name='tempest-VolumesGetTest-Volume-808389177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8bb944-a308-4972-9209-d8fcd8ef3a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:12Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Creating volume df8bb944-a308-4972-9209-d8fcd8ef3a5a {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:44:12 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:12 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a 1073741824 Sep 05 04:44:12 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:13 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a 1073741824" returned: 0 in 0.548s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:13 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a Sep 05 04:44:13 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:13 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a" returned: 0 in 0.290s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.845s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a02cc0c-b58e-41ad-8d71-62a9fd08b4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff527805-9745-4195-9152-4caeda2b41d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Creating offline snapshot 7a803139-5313-409c-a219-1d9d23aefe3a of volume be4f23ae-b2ac-4446-95fc-2b4eede3004c {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:44:13 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Volume volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a (df8bb944-a308-4972-9209-d8fcd8ef3a5a): created successfully Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff527805-9745-4195-9152-4caeda2b41d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (63b5286d-13d1-41fa-8649-94e42da7ff39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[316a676b-da0f-4e38-86fe-60bbf31516bf]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:13 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-11a17874-7d1d-4bb7-82fd-e063efd524d6 tempest-VolumesGetTest-1624282460 None] Created volume successfully. Sep 05 04:44:13 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c Sep 05 04:44:13 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:13 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c" returned: 0 in 0.447s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:13 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a 1G Sep 05 04:44:13 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:14 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a 1G" returned: 0 in 0.713s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-df8bb944-a308-4972-9209-d8fcd8ef3a5a-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:14 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a Sep 05 04:44:14 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Lock "cinder-df8bb944-a308-4972-9209-d8fcd8ef3a5a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-quobyte-df8bb944-a308-4972-9209-d8fcd8ef3a5a" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-df8bb944-a308-4972-9209-d8fcd8ef3a5a" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:14 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4764378-faeb-4855-8df9-1fa340a80f7e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:15 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a Sep 05 04:44:15 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:15 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a" returned: 0 in 0.423s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:15 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a is being set with open permissions: ugo+rw Sep 05 04:44:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:15 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a Sep 05 04:44:15 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:15 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a" returned: 0 in 0.327s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:15 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a" returned: 0 in 0.573s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:15 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a Sep 05 04:44:15 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:15 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.info Sep 05 04:44:15 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:15 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.info" returned: 0 in 0.350s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:15 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.info is being set with open permissions: ugo+rw Sep 05 04:44:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:15 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.info Sep 05 04:44:15 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:15 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df8bb944-a308-4972-9209-d8fcd8ef3a5a" returned: 0 in 0.466s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-df8bb944-a308-4972-9209-d8fcd8ef3a5a" released by "delete_volume" :: held 1.115s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Created reservations ['aff46678-30dd-4237-9e72-0978384b86e1', 'c746160d-b71b-42e0-9836-227e21df3b7b', '0be9ef3e-9d3f-4c91-8e44-5ec279d75f5d', '36baf48b-046f-4356-bed9-4f636d456eea'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:16 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:44:16 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:16 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.info" returned: 0 in 0.521s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Flow 'volume_create_manager' (abdef77e-180f-417c-af2e-eba1511e3183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eff5403-e8de-446e-8be9-9c5e5831c492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eff5403-e8de-446e-8be9-9c5e5831c492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1279534100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770af7ac-29a3-435c-b8a1-70b5c56f34c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d227bd17b1c64ced8aadd89f331d906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:16Z,use_quota=True,user_id='e53717cdc59a46a0b742c2b0649afa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2371b5d7-e434-40d6-9752-d8dfe1df209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2371b5d7-e434-40d6-9752-d8dfe1df209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402bf5a9-77ba-4a66-8652-195fe3d2d0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402bf5a9-77ba-4a66-8652-195fe3d2d0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770af7ac-29a3-435c-b8a1-70b5c56f34c8', 'volume_name': 'volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41648e3-1112-4a0d-b2e0-ccecb41c68fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41648e3-1112-4a0d-b2e0-ccecb41c68fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05bd64c-afc9-4c80-8c18-5d0cde7b34fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:16 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Volume 770af7ac-29a3-435c-b8a1-70b5c56f34c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8', 'volume_size': 1} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1279534100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770af7ac-29a3-435c-b8a1-70b5c56f34c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d227bd17b1c64ced8aadd89f331d906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:16Z,use_quota=True,user_id='e53717cdc59a46a0b742c2b0649afa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Creating volume 770af7ac-29a3-435c-b8a1-70b5c56f34c8 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:44:16 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:16 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6206c229-f619-4f44-9bba-aef5aaab04bb tempest-SnapshotMetadataTestJSON-362443 None] Create snapshot completed successfully Sep 05 04:44:16 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8 1073741824 Sep 05 04:44:16 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:16 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.458s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:44:16 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Deleted volume successfully. Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8df49442-708d-4a9e-85ab-87a3d704650b tempest-VolumesGetTest-1624282460 None] Lock "cinder-df8bb944-a308-4972-9209-d8fcd8ef3a5a-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Flow 'volume_create_manager' (2acb2978-8893-4cd8-bb78-4e33151a26dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c19c4ed-57ce-44af-8f83-02830d8e17b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c19c4ed-57ce-44af-8f83-02830d8e17b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-633805712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aacd9c8-8109-4af0-abc5-562b34170107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d227bd17b1c64ced8aadd89f331d906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:17Z,use_quota=True,user_id='e53717cdc59a46a0b742c2b0649afa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db8cca5-85c5-4328-b6ef-fec49bc5b00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db8cca5-85c5-4328-b6ef-fec49bc5b00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928fea3d-0f41-4a28-8613-c5fec868ca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928fea3d-0f41-4a28-8613-c5fec868ca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aacd9c8-8109-4af0-abc5-562b34170107', 'volume_name': 'volume-2aacd9c8-8109-4af0-abc5-562b34170107', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d2eb6c-85c1-43c7-9f11-f64c199c2491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d2eb6c-85c1-43c7-9f11-f64c199c2491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd3082e-eb63-4ab9-87a7-c1a0cfab4119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:17 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Volume 2aacd9c8-8109-4af0-abc5-562b34170107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aacd9c8-8109-4af0-abc5-562b34170107', 'volume_size': 1} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-8e854b28-ae7f-4894-9e4e-01824de99f99-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Lock "cinder-8e854b28-ae7f-4894-9e4e-01824de99f99-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-quobyte-8e854b28-ae7f-4894-9e4e-01824de99f99" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:17 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8 1073741824" returned: 0 in 0.745s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-8e854b28-ae7f-4894-9e4e-01824de99f99" acquired by "delete_volume" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4365404-fbf0-4b6c-b0c4-58e551fa3dc3]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:17 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8 Sep 05 04:44:17 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:17 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 Sep 05 04:44:17 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:17 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8" returned: 0 in 0.388s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-633805712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aacd9c8-8109-4af0-abc5-562b34170107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d227bd17b1c64ced8aadd89f331d906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:17Z,use_quota=True,user_id='e53717cdc59a46a0b742c2b0649afa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Creating volume 2aacd9c8-8109-4af0-abc5-562b34170107 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:44:17 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05bd64c-afc9-4c80-8c18-5d0cde7b34fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:17 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107 1073741824 Sep 05 04:44:17 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5571c61-294e-4e99-ae9a-5eebb01a100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:17 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Volume volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8 (770af7ac-29a3-435c-b8a1-70b5c56f34c8): created successfully Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5571c61-294e-4e99-ae9a-5eebb01a100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Flow 'volume_create_manager' (abdef77e-180f-417c-af2e-eba1511e3183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:18 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9ead35fe-a286-44c4-9a3c-82ddd68ee3ad tempest-TestServerVolumeAttachmentScenario-2055509081 None] Created volume successfully. Sep 05 04:44:18 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99" returned: 0 in 0.686s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:18 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99 Sep 05 04:44:18 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Acquiring lock "cinder-7a803139-5313-409c-a219-1d9d23aefe3a-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:18 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8e854b28-ae7f-4894-9e4e-01824de99f99" returned: 0 in 0.495s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-8e854b28-ae7f-4894-9e4e-01824de99f99" released by "delete_volume" :: held 1.276s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Lock "cinder-7a803139-5313-409c-a219-1d9d23aefe3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Acquiring lock "cinder-quobyte-be4f23ae-b2ac-4446-95fc-2b4eede3004c" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:18 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107 1073741824" returned: 0 in 0.807s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Lock "cinder-quobyte-be4f23ae-b2ac-4446-95fc-2b4eede3004c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Acquiring lock "cinder-quobyte-7a803139-5313-409c-a219-1d9d23aefe3a" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Lock "cinder-quobyte-7a803139-5313-409c-a219-1d9d23aefe3a" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Deleting offline snapshot 7a803139-5313-409c-a219-1d9d23aefe3a of volume be4f23ae-b2ac-4446-95fc-2b4eede3004c {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] snapshot_file for this snap is: volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb0c545-8d65-4a00-b34a-d09f9c9ec7d0]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Created reservations ['8ad50179-2bb0-411b-b43a-68dd4ee2d477', '0a929c8c-05a4-4ac6-af48-233c2a4181aa', '4dae9596-72d1-4237-8340-b3923bcc9f56', '8998da42-be83-4062-b1e2-549f0319d0d2'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:18 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107 Sep 05 04:44:18 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:18 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:18 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:18 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:44:18 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:19 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107" returned: 0 in 0.428s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd3082e-eb63-4ab9-87a7-c1a0cfab4119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aacd9c8-8109-4af0-abc5-562b34170107', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3571b75e-d3f9-49cd-bb2e-2bc1d63a0e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:19 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Volume volume-2aacd9c8-8109-4af0-abc5-562b34170107 (2aacd9c8-8109-4af0-abc5-562b34170107): created successfully Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3571b75e-d3f9-49cd-bb2e-2bc1d63a0e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Flow 'volume_create_manager' (2acb2978-8893-4cd8-bb78-4e33151a26dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:19 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:44:19 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Deleted volume successfully. Sep 05 04:44:19 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-748d22ef-c2ea-4a69-9a68-7e26cb6da344 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Created volume successfully. Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-72e2c4d8-8731-4fa0-9cdf-cfba917af9f4 tempest-VolumesGetTest-1624282460 None] Lock "cinder-8e854b28-ae7f-4894-9e4e-01824de99f99-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:19 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a" returned: 0 in 0.668s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3002fa08-5327-4db9-bc1f-f6b70aa25098]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-fb7749e3-660b-4a3e-b61e-7f6043cbd893-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Lock "cinder-fb7749e3-660b-4a3e-b61e-7f6043cbd893-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:19 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c Sep 05 04:44:19 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-quobyte-fb7749e3-660b-4a3e-b61e-7f6043cbd893" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-fb7749e3-660b-4a3e-b61e-7f6043cbd893" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a937932-da96-42a1-89f6-70e7d9293476]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:19 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 Sep 05 04:44:19 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:20 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c" returned: 0 in 0.561s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:20 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a Sep 05 04:44:20 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:20 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893" returned: 0 in 0.520s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:20 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893 Sep 05 04:44:20 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:20 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a" returned: 0 in 0.467s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:20 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a Sep 05 04:44:20 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:20 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-fb7749e3-660b-4a3e-b61e-7f6043cbd893" returned: 0 in 0.335s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-fb7749e3-660b-4a3e-b61e-7f6043cbd893" released by "delete_volume" :: held 0.947s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Created reservations ['96f1a2ca-68ea-4771-b0dd-70d97c32ad56', 'b58aa2bd-18ae-4852-b472-88252ea352dd', '25521a1c-d2f0-4501-b3bc-657387c091d3', 'e14f95f2-2fee-41bb-bd58-4047e3028881'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:44:20 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c.7a803139-5313-409c-a219-1d9d23aefe3a" returned: 0 in 0.409s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:20 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:44:20 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Lock "cinder-quobyte-7a803139-5313-409c-a219-1d9d23aefe3a" released by "_delete_snapshot" :: held 2.287s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Lock "cinder-quobyte-be4f23ae-b2ac-4446-95fc-2b4eede3004c" released by "delete_snapshot" :: held 2.338s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:21 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Created reservations ['ac3f462c-7f24-4f74-8694-d4efc69ebfa9', 'feab158e-ac6c-47fd-8132-7c94de32137f', '8588e668-0664-47ff-83bb-85d1264ceae1', 'e2167c7b-10c9-44b7-93fd-767df05c1767'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:44:21 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.346s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:21 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:44:21 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Deleted volume successfully. Sep 05 04:44:21 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Delete snapshot completed successfully. Sep 05 04:44:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6d5a4521-4c7b-4ffe-b345-71e19ee19afd tempest-SnapshotMetadataTestJSON-362443 None] Lock "cinder-7a803139-5313-409c-a219-1d9d23aefe3a-delete_snapshot" released by "delete_snapshot" :: held 2.672s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-24805bcb-00a8-479b-bd3c-d52888c5576a tempest-VolumesGetTest-1624282460 None] Lock "cinder-fb7749e3-660b-4a3e-b61e-7f6043cbd893-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Acquiring lock "cinder-be4f23ae-b2ac-4446-95fc-2b4eede3004c-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Lock "cinder-be4f23ae-b2ac-4446-95fc-2b4eede3004c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Acquiring lock "cinder-quobyte-be4f23ae-b2ac-4446-95fc-2b4eede3004c" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Lock "cinder-quobyte-be4f23ae-b2ac-4446-95fc-2b4eede3004c" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0973caba-2187-4173-a727-44f8ed4b8521]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:22 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c Sep 05 04:44:22 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:22 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c" returned: 0 in 0.424s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:22 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c Sep 05 04:44:22 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:22 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-be4f23ae-b2ac-4446-95fc-2b4eede3004c" returned: 0 in 0.358s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Lock "cinder-quobyte-be4f23ae-b2ac-4446-95fc-2b4eede3004c" released by "delete_volume" :: held 0.886s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (cff52557-f753-4578-ae71-8058a1404617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ced0d73-51a9-4d13-83c9-039b0eedc28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Created reservations ['068cec33-21ae-4f0c-a297-a4a5d4d7b478', '8c32771c-65b6-4b50-84b9-88338731112a', '411ddb11-b4c5-44ab-b74d-218346a2c05c', '79190cd1-36fe-4a3d-a11a-f116f8f42741'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ced0d73-51a9-4d13-83c9-039b0eedc28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-372572796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af47985e-33a3-48b3-9a42-55809cff172c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:23Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0937b5a-9045-46ba-b6b1-e0cf473cb216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0937b5a-9045-46ba-b6b1-e0cf473cb216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8973c470-e6e3-4c53-a84b-0e198ffb7ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.image.glance [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Creating Keystone auth plugin from conf {{(pid=89807) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:23 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:44:23 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:23 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.298s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:44:23 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Deleted volume successfully. Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c04c7f59-5f5b-46e9-b646-5a6fdc451eed tempest-SnapshotMetadataTestJSON-362443 None] Lock "cinder-be4f23ae-b2ac-4446-95fc-2b4eede3004c-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8973c470-e6e3-4c53-a84b-0e198ffb7ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af47985e-33a3-48b3-9a42-55809cff172c', 'volume_name': 'volume-af47985e-33a3-48b3-9a42-55809cff172c', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09119f93-97e0-417d-882e-c2caf67b830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09119f93-97e0-417d-882e-c2caf67b830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be603816-4350-4a6c-9cc1-14bd4ea67de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:23 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Volume af47985e-33a3-48b3-9a42-55809cff172c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af47985e-33a3-48b3-9a42-55809cff172c', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 04:44:23 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Trying to clone af47985e-33a3-48b3-9a42-55809cff172c from image d96433d1-6b83-48c1-88e8-5f747cd5fb19 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]). {{(pid=89807) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 04:44:24 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 04:44:24 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Image download 20.69 MB at 20.69 MB/s Sep 05 04:44:24 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[765c5f75-0fff-4853-a563-bb584d50121a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:24 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD Sep 05 04:44:24 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:24 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD" returned: 0 in 0.469s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:24 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Temporary image d96433d1-6b83-48c1-88e8-5f747cd5fb19 is fetched for user ebb3d56451ce4e4aacd082d07ae9d7a6. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 04:44:24 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f321b-366a-46e6-a8ce-8a9315fff133]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:24 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD Sep 05 04:44:24 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:25 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-372572796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af47985e-33a3-48b3-9a42-55809cff172c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:23Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Creating volume af47985e-33a3-48b3-9a42-55809cff172c {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:44:25 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:25 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c 1073741824 Sep 05 04:44:25 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:25 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c 1073741824" returned: 0 in 0.693s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:25 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c Sep 05 04:44:26 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:26 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c" returned: 0 in 0.308s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:44:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:26 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Attempting download of d96433d1-6b83-48c1-88e8-5f747cd5fb19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}])) to volume af47985e-33a3-48b3-9a42-55809cff172c. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 04:44:26 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a07732-b171-49e6-af2c-2a9de4146fac]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_lbndmhx2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:26 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_lbndmhx2 Sep 05 04:44:26 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:26 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_lbndmhx2" returned: 0 in 0.375s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_lbndmhx2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:26 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_lbndmhx2 Sep 05 04:44:26 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:27 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_lbndmhx2" returned: 1 in 0.555s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_lbndmhx2' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:44:27 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d204ad-ba4a-4a2a-9a64-649c658f9958]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:27 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD Sep 05 04:44:27 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:27 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD" returned: 0 in 0.468s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:27 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] d96433d1-6b83-48c1-88e8-5f747cd5fb19 was qcow2, converting to qcow2 {{(pid=89807) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 04:44:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:27 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c Sep 05 04:44:27 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:31 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c" returned: 0 in 4.018s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:31 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_cqiogr05devstack@QuobyteHD, size 112.00 MB, duration 4.02 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:44:31 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Converted 112.00 MB image at 27.87 MB/s Sep 05 04:44:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:31 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c 1G Sep 05 04:44:31 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:32 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c 1G" returned: 0 in 0.666s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:32 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Downloaded image d96433d1-6b83-48c1-88e8-5f747cd5fb19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}])) to volume af47985e-33a3-48b3-9a42-55809cff172c successfully. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 04:44:32 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Temporary image d96433d1-6b83-48c1-88e8-5f747cd5fb19 for user ebb3d56451ce4e4aacd082d07ae9d7a6 is deleted. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 04:44:32 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Marking volume af47985e-33a3-48b3-9a42-55809cff172c as bootable. {{(pid=89807) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 04:44:32 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Copying metadata from image d96433d1-6b83-48c1-88e8-5f747cd5fb19 to af47985e-33a3-48b3-9a42-55809cff172c. {{(pid=89807) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 04:44:32 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Creating volume glance metadata for volume af47985e-33a3-48b3-9a42-55809cff172c backed by image d96433d1-6b83-48c1-88e8-5f747cd5fb19 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89807) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 04:44:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be603816-4350-4a6c-9cc1-14bd4ea67de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af47985e-33a3-48b3-9a42-55809cff172c', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1883aa87-2224-406a-9266-2bcd9b55793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:32 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Volume volume-af47985e-33a3-48b3-9a42-55809cff172c (af47985e-33a3-48b3-9a42-55809cff172c): created successfully Sep 05 04:44:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1883aa87-2224-406a-9266-2bcd9b55793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (cff52557-f753-4578-ae71-8058a1404617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b6da21f9-a4bc-47f2-b0e8-8a0d73d02f54 tempest-VolumesGetTest-1624282460 None] Created volume successfully. Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=113,cinder:INSERT=49,cinder:UPDATE=148,cinder:DELETE=12 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Flow 'volume_create_manager' (c630c4ea-6570-4440-a0a0-d493bfe5aeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e61f392-ac36-4ed4-90bc-121f8438d5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e61f392-ac36-4ed4-90bc-121f8438d5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1689061164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2069a53c-9aa2-441a-b323-0a332983c782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0c53b7a6354578ad941623b7dfd949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:34Z,use_quota=True,user_id='ba653f4b8f2e4d8bb436a26d6bae1c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2caba4c4-abe9-4712-9f2d-5dcf8b639f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2caba4c4-abe9-4712-9f2d-5dcf8b639f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4116070c-40af-47b0-aa96-bd67fcb60d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4116070c-40af-47b0-aa96-bd67fcb60d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2069a53c-9aa2-441a-b323-0a332983c782', 'volume_name': 'volume-2069a53c-9aa2-441a-b323-0a332983c782', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac7a73b-4d01-4714-be86-40ad230eb6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac7a73b-4d01-4714-be86-40ad230eb6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b551c164-68b3-4e82-bab6-45b14658a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:33 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Volume 2069a53c-9aa2-441a-b323-0a332983c782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2069a53c-9aa2-441a-b323-0a332983c782', 'volume_size': 1} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1689061164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2069a53c-9aa2-441a-b323-0a332983c782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0c53b7a6354578ad941623b7dfd949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:34Z,use_quota=True,user_id='ba653f4b8f2e4d8bb436a26d6bae1c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Creating volume 2069a53c-9aa2-441a-b323-0a332983c782 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:44:33 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:44:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:33 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782 1073741824 Sep 05 04:44:33 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (a6c6faf2-1f0d-4867-8d86-027526f8848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9948b0-6899-4395-8c16-2a2681a156eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9948b0-6899-4395-8c16-2a2681a156eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-239860577',display_name='tempest-VolumesGetTest-Volume-1348498388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:34Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f51bdce-0f26-47c2-9588-d9d1f1b75efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f51bdce-0f26-47c2-9588-d9d1f1b75efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bc6cc8-f935-48d9-a0f7-8b3af74f1f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bc6cc8-f935-48d9-a0f7-8b3af74f1f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba', 'volume_name': 'volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bf6a33-77cd-43b3-a4c3-73b508e94dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bf6a33-77cd-43b3-a4c3-73b508e94dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c0dbf5-ad47-479b-a8fa-e405d49c278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:34 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Volume 394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba', 'volume_size': 1} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:34 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782 1073741824" returned: 0 in 0.890s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:34 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782 Sep 05 04:44:34 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:35 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782" returned: 0 in 0.472s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-239860577',display_name='tempest-VolumesGetTest-Volume-1348498388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616bf338a0497c84a9619087337cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:34Z,use_quota=True,user_id='ebb3d56451ce4e4aacd082d07ae9d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Creating volume 394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:44:35 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:35 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba 1073741824 Sep 05 04:44:35 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b551c164-68b3-4e82-bab6-45b14658a397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2069a53c-9aa2-441a-b323-0a332983c782', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26b33a1-71f3-454c-a8d2-4aa0e89e149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:35 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Volume volume-2069a53c-9aa2-441a-b323-0a332983c782 (2069a53c-9aa2-441a-b323-0a332983c782): created successfully Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26b33a1-71f3-454c-a8d2-4aa0e89e149f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Flow 'volume_create_manager' (c630c4ea-6570-4440-a0a0-d493bfe5aeeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-bbf5a080-cc2d-44aa-a77d-4129c26efb79 tempest-VolumesTransfersV355Test-1247217994 None] Created volume successfully. Sep 05 04:44:36 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba 1073741824" returned: 0 in 1.162s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:36 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba Sep 05 04:44:36 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:36 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba" returned: 0 in 0.425s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:44:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c0dbf5-ad47-479b-a8fa-e405d49c278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d21fb86-99ba-4d2d-8fc7-5debf62164b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:37 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Volume volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba (394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba): created successfully Sep 05 04:44:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d21fb86-99ba-4d2d-8fc7-5debf62164b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Flow 'volume_create_manager' (a6c6faf2-1f0d-4867-8d86-027526f8848a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b556938f-9b88-4979-b0d9-1ee5defdceed tempest-VolumesGetTest-1624282460 None] Created volume successfully. Sep 05 04:44:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9dd0e1ec-2ec2-417d-9312-757fb7fd048b tempest-VolumesTransfersV355Test-158415915 None] Transfer volume completed successfully. Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Lock "cinder-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-quobyte-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba" acquired by "delete_volume" :: waited 0.038s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Acquiring lock "cinder-2069a53c-9aa2-441a-b323-0a332983c782-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc917ea5-37b0-432c-8cab-293b80bbf063]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Lock "cinder-2069a53c-9aa2-441a-b323-0a332983c782-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Acquiring lock "cinder-quobyte-2069a53c-9aa2-441a-b323-0a332983c782" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Lock "cinder-quobyte-2069a53c-9aa2-441a-b323-0a332983c782" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aca2a75-8aa9-4ffc-b475-8cc8784e537e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:38 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba Sep 05 04:44:38 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:38 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782 Sep 05 04:44:38 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:38 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba" returned: 0 in 0.542s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:39 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba Sep 05 04:44:39 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:39 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782" returned: 0 in 0.517s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:39 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782 Sep 05 04:44:39 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:39 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba" returned: 0 in 0.348s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba" released by "delete_volume" :: held 1.046s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Created reservations ['7e8b2fd2-da14-425c-b25a-fdcec15bb70b', '0562b2dd-e328-4036-bf6c-dd9d8c93c3ae', '6c693f2e-68e4-4854-859f-17831a6fd7b8', 'c0b2b450-7db0-4bfe-9fc6-71395fb96cde'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:39 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2069a53c-9aa2-441a-b323-0a332983c782" returned: 0 in 0.539s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:39 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:44:39 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Lock "cinder-quobyte-2069a53c-9aa2-441a-b323-0a332983c782" released by "delete_volume" :: held 1.125s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Created reservations ['3694c534-6182-4f46-9d92-37990e1a4259', '2e727e06-7796-4515-bec2-b34627d6e423', 'a76dcc0b-7608-473e-9e91-9ed0e1e7ec94', 'bad28cfb-9446-4b91-8efb-43b2eefc9298'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:39 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:44:39 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:40 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.376s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:40 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.669s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:44:40 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Deleted volume successfully. Sep 05 04:44:40 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Deleted volume successfully. Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-07dac542-b00b-40ed-9444-2a54e4b18e8f tempest-VolumesTransfersV355Test-1144503828 None] Lock "cinder-2069a53c-9aa2-441a-b323-0a332983c782-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9ddddd9b-a7d4-4874-a954-23b5d021cb80 tempest-VolumesGetTest-1624282460 None] Lock "cinder-394d5c7e-b32b-4c8c-a9e4-8e294b8bcbba-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-af47985e-33a3-48b3-9a42-55809cff172c-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Lock "cinder-af47985e-33a3-48b3-9a42-55809cff172c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Acquiring lock "cinder-quobyte-af47985e-33a3-48b3-9a42-55809cff172c" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-af47985e-33a3-48b3-9a42-55809cff172c" acquired by "delete_volume" :: waited 0.054s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4fdd43-23af-4d0d-96fb-9e785ca3ffb7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:41 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c Sep 05 04:44:41 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:41 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c" returned: 0 in 0.557s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:41 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c Sep 05 04:44:41 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Flow 'volume_create_manager' (aedc7c09-301f-4e57-82e3-64e71ecc2f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4498d72-33a2-4416-9cbe-649fde2b4f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4498d72-33a2-4416-9cbe-649fde2b4f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2008663441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bf9f12-e19b-4a2d-8a7e-e01324201574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0c53b7a6354578ad941623b7dfd949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:42Z,use_quota=True,user_id='ba653f4b8f2e4d8bb436a26d6bae1c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349a1ef2-754a-491c-bb85-d3c6436ad348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349a1ef2-754a-491c-bb85-d3c6436ad348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8d7f42-175d-42e3-82a9-900090e0eb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8d7f42-175d-42e3-82a9-900090e0eb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57bf9f12-e19b-4a2d-8a7e-e01324201574', 'volume_name': 'volume-57bf9f12-e19b-4a2d-8a7e-e01324201574', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22b8b0c-bd65-446d-8058-54ef8cc8ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22b8b0c-bd65-446d-8058-54ef8cc8ca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6c0749-57ee-48d2-afc4-511634b41aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Volume 57bf9f12-e19b-4a2d-8a7e-e01324201574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57bf9f12-e19b-4a2d-8a7e-e01324201574', 'volume_size': 1} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2008663441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bf9f12-e19b-4a2d-8a7e-e01324201574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0c53b7a6354578ad941623b7dfd949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:44:42Z,use_quota=True,user_id='ba653f4b8f2e4d8bb436a26d6bae1c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Creating volume 57bf9f12-e19b-4a2d-8a7e-e01324201574 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:44:41 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:41 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574 1073741824 Sep 05 04:44:41 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:41 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-af47985e-33a3-48b3-9a42-55809cff172c" returned: 0 in 0.538s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Lock "cinder-quobyte-af47985e-33a3-48b3-9a42-55809cff172c" released by "delete_volume" :: held 1.155s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Created reservations ['ff2199cc-29e6-4ea9-9636-82f2bedd001a', '6ecb3f0a-c604-4346-96ca-7fcef435d11d', 'be13ddb1-3e22-4cb6-89e2-6e1025b5c95c', 'a11b1d9e-018b-41ef-b2f2-a458914c0cbf'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:42 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:44:42 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:42 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574 1073741824" returned: 0 in 0.621s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:42 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.321s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:44:42 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574 Sep 05 04:44:42 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Deleted volume successfully. Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6566cf26-75cd-46bd-b557-21848da1fc64 tempest-VolumesGetTest-1624282460 None] Lock "cinder-af47985e-33a3-48b3-9a42-55809cff172c-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:42 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574" returned: 0 in 0.308s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6c0749-57ee-48d2-afc4-511634b41aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57bf9f12-e19b-4a2d-8a7e-e01324201574', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e46059-39a9-436b-904d-1473a5fced8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:44:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Volume volume-57bf9f12-e19b-4a2d-8a7e-e01324201574 (57bf9f12-e19b-4a2d-8a7e-e01324201574): created successfully Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e46059-39a9-436b-904d-1473a5fced8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:44:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Flow 'volume_create_manager' (aedc7c09-301f-4e57-82e3-64e71ecc2f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:44:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-fca0bcd1-9158-4373-8e20-37651f8df8d7 tempest-VolumesTransfersV355Test-1247217994 None] Created volume successfully. Sep 05 04:44:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Acquiring lock "cinder-57bf9f12-e19b-4a2d-8a7e-e01324201574-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Lock "cinder-57bf9f12-e19b-4a2d-8a7e-e01324201574-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Acquiring lock "cinder-quobyte-57bf9f12-e19b-4a2d-8a7e-e01324201574" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:44:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Lock "cinder-quobyte-57bf9f12-e19b-4a2d-8a7e-e01324201574" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:44:44 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d18a1a-c171-40a7-b4d1-77fa0c0fecf8]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:44:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:44 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574 Sep 05 04:44:44 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:44 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574" returned: 0 in 0.406s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:44 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574 Sep 05 04:44:44 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:45 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-57bf9f12-e19b-4a2d-8a7e-e01324201574" returned: 0 in 0.301s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Lock "cinder-quobyte-57bf9f12-e19b-4a2d-8a7e-e01324201574" released by "delete_volume" :: held 0.764s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Created reservations ['30841af2-85a7-45cf-bba5-fad6cae9644d', 'e7c45f84-c595-48b7-b029-604b0ade9d62', 'c5e6ad8c-75a3-4d05-8999-158dbd5531e2', '9dbaa33c-da2c-40a7-b895-b5dcd09aa00f'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:44:45 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:44:45 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:44:45 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.279s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:44:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Deleted volume successfully. Sep 05 04:44:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d6be69d9-53a3-41f1-8da6-a53b33f952ba tempest-VolumesTransfersV355Test-1144503828 None] Lock "cinder-57bf9f12-e19b-4a2d-8a7e-e01324201574-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:44:55 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=22,cinder:UPDATE=38,cinder:INSERT=11,cinder:DELETE=6 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:44:55 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=86,cinder:INSERT=27,cinder:UPDATE=118,cinder:DELETE=7 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:45:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-2247e561-e807-420e-8465-ce35d6eec694 req-b3dfa19c-e8dd-43e1-9c9a-881ffa448d93 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-2247e561-e807-420e-8465-ce35d6eec694 req-b3dfa19c-e8dd-43e1-9c9a-881ffa448d93 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-2247e561-e807-420e-8465-ce35d6eec694 req-b3dfa19c-e8dd-43e1-9c9a-881ffa448d93 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-2247e561-e807-420e-8465-ce35d6eec694 req-b3dfa19c-e8dd-43e1-9c9a-881ffa448d93 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aad0a8e9-0d24-48cd-8beb-1cd4c0eba683', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:45:03 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-2247e561-e807-420e-8465-ce35d6eec694 req-b3dfa19c-e8dd-43e1-9c9a-881ffa448d93 tempest-TestServerVolumeAttachmentScenario-2055509081 None] attachment_update completed successfully. Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Flow 'volume_create_manager' (c6201426-6d93-4db5-aaab-90e53fcdf565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edf7e77-ce52-42ec-b023-6c309be9b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edf7e77-ce52-42ec-b023-6c309be9b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1907517387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598e5897-798d-4389-8f00-e99b57f20819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef52441f8cc141e1b286fd56aa6c6bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:45:04Z,use_quota=True,user_id='0964760a6cc746878c08020235cb8cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a285f1c-10de-4139-8404-06a764b70f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a285f1c-10de-4139-8404-06a764b70f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba8ab65-181b-45b9-a3fd-81931c29da8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba8ab65-181b-45b9-a3fd-81931c29da8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598e5897-798d-4389-8f00-e99b57f20819', 'volume_name': 'volume-598e5897-798d-4389-8f00-e99b57f20819', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d103cf2e-e9ca-496a-b76a-0f91afde5a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d103cf2e-e9ca-496a-b76a-0f91afde5a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5cf476-9824-4306-8bff-3c691e2df704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:04 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Volume 598e5897-798d-4389-8f00-e99b57f20819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598e5897-798d-4389-8f00-e99b57f20819', 'volume_size': 1} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1907517387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598e5897-798d-4389-8f00-e99b57f20819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef52441f8cc141e1b286fd56aa6c6bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:45:04Z,use_quota=True,user_id='0964760a6cc746878c08020235cb8cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Creating volume 598e5897-798d-4389-8f00-e99b57f20819 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:45:04 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:45:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:04 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819 1073741824 Sep 05 04:45:04 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:05 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819 1073741824" returned: 0 in 0.653s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:05 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819 Sep 05 04:45:05 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:05 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819" returned: 0 in 0.437s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:45:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5cf476-9824-4306-8bff-3c691e2df704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598e5897-798d-4389-8f00-e99b57f20819', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b842d6-16be-45cb-aa67-1eddfc368976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:05 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Volume volume-598e5897-798d-4389-8f00-e99b57f20819 (598e5897-798d-4389-8f00-e99b57f20819): created successfully Sep 05 04:45:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b842d6-16be-45cb-aa67-1eddfc368976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Flow 'volume_create_manager' (c6201426-6d93-4db5-aaab-90e53fcdf565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:45:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3563979d-7493-4769-a566-9e9f6a4c8977 tempest-AttachVolumeTestJSON-947406945 None] Created volume successfully. Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Flow 'volume_create_manager' (15921df9-2e2f-4fc6-83c6-63688145a369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c593c58-18d7-4c5d-a4ea-2a1e8cb9a62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c593c58-18d7-4c5d-a4ea-2a1e8cb9a62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-19665840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81926e2d-88d1-4976-9859-ac07b1a30dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71a0517e3174330855308587af4c670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:45:06Z,use_quota=True,user_id='1fc4d65de1244919aaed3fc202caf9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c222656-b2e7-431b-8b86-e0a09e271d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c222656-b2e7-431b-8b86-e0a09e271d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2d7769-0aae-4920-a7c9-97bbd39b32ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2d7769-0aae-4920-a7c9-97bbd39b32ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81926e2d-88d1-4976-9859-ac07b1a30dd5', 'volume_name': 'volume-81926e2d-88d1-4976-9859-ac07b1a30dd5', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129ff6ee-0423-4722-87f7-3153fced1888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129ff6ee-0423-4722-87f7-3153fced1888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea321207-9a8d-465a-a145-d286a7e56501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:06 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Volume 81926e2d-88d1-4976-9859-ac07b1a30dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81926e2d-88d1-4976-9859-ac07b1a30dd5', 'volume_size': 1} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-19665840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81926e2d-88d1-4976-9859-ac07b1a30dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71a0517e3174330855308587af4c670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:45:06Z,use_quota=True,user_id='1fc4d65de1244919aaed3fc202caf9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Creating volume 81926e2d-88d1-4976-9859-ac07b1a30dd5 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:45:06 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:06 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 1073741824 Sep 05 04:45:06 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:06 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 1073741824" returned: 0 in 0.583s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:06 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 Sep 05 04:45:06 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:07 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5" returned: 0 in 0.362s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea321207-9a8d-465a-a145-d286a7e56501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81926e2d-88d1-4976-9859-ac07b1a30dd5', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e44efd-f978-4865-96f4-d58c14732735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:07 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Volume volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 (81926e2d-88d1-4976-9859-ac07b1a30dd5): created successfully Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e44efd-f978-4865-96f4-d58c14732735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Flow 'volume_create_manager' (15921df9-2e2f-4fc6-83c6-63688145a369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:45:07 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b1f95894-9021-4602-a24c-8d1b3bd10091 tempest-VolumesActionsTest-902818202 None] Created volume successfully. Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-ee159ce5-e178-4e58-abb5-b0bf1402d26f req-41b2cad3-1e54-4f95-82ee-1f77627faff1 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-ee159ce5-e178-4e58-abb5-b0bf1402d26f req-41b2cad3-1e54-4f95-82ee-1f77627faff1 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-ee159ce5-e178-4e58-abb5-b0bf1402d26f req-41b2cad3-1e54-4f95-82ee-1f77627faff1 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-ee159ce5-e178-4e58-abb5-b0bf1402d26f req-41b2cad3-1e54-4f95-82ee-1f77627faff1 tempest-AttachVolumeTestJSON-947406945 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-598e5897-798d-4389-8f00-e99b57f20819', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88a5517e-dda6-438e-81ed-b5fd3c93f46e', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:45:07 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-ee159ce5-e178-4e58-abb5-b0bf1402d26f req-41b2cad3-1e54-4f95-82ee-1f77627faff1 tempest-AttachVolumeTestJSON-947406945 None] attachment_update completed successfully. Sep 05 04:45:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-f6f12a78-72e7-4a43-8c94-e5e03a772ac1 req-089afad3-cd62-4e09-857d-efee1bff5d17 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-f6f12a78-72e7-4a43-8c94-e5e03a772ac1 req-089afad3-cd62-4e09-857d-efee1bff5d17 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-f6f12a78-72e7-4a43-8c94-e5e03a772ac1 req-089afad3-cd62-4e09-857d-efee1bff5d17 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-f6f12a78-72e7-4a43-8c94-e5e03a772ac1 req-089afad3-cd62-4e09-857d-efee1bff5d17 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-2aacd9c8-8109-4af0-abc5-562b34170107', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79896f6b-1118-4c39-970a-e3e8c764baee', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:45:09 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-f6f12a78-72e7-4a43-8c94-e5e03a772ac1 req-089afad3-cd62-4e09-857d-efee1bff5d17 tempest-TestServerVolumeAttachmentScenario-2055509081 None] attachment_update completed successfully. Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:10 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:45:10 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:10 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.300s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:45:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:45:12 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-7fb426ac-c36f-4511-8813-f4f8273f8c09 req-543b1337-aa9f-48c7-ae17-de38e011970d tempest-TestServerVolumeAttachmentScenario-2055509081 None] Terminate volume connection completed successfully. Sep 05 04:45:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-7fb426ac-c36f-4511-8813-f4f8273f8c09 req-543b1337-aa9f-48c7-ae17-de38e011970d tempest-TestServerVolumeAttachmentScenario-2055509081 None] Deleting attachment 79896f6b-1118-4c39-970a-e3e8c764baee. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:45:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-dedb4e4c-0e17-41a8-ba4a-3c92e7d21471 req-18edf2fa-048f-4256-abf6-eccde202c5e8 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Terminate volume connection completed successfully. Sep 05 04:45:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-dedb4e4c-0e17-41a8-ba4a-3c92e7d21471 req-18edf2fa-048f-4256-abf6-eccde202c5e8 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Deleting attachment aad0a8e9-0d24-48cd-8beb-1cd4c0eba683. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:45:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6629e21c-d9a6-4db9-94c4-a5d10ce262ea tempest-VolumesActionsTest-902818202 None] Acquiring lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5" by "attach_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:45:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6629e21c-d9a6-4db9-94c4-a5d10ce262ea tempest-VolumesActionsTest-902818202 None] Lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5" acquired by "attach_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:45:24 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6629e21c-d9a6-4db9-94c4-a5d10ce262ea tempest-VolumesActionsTest-902818202 None] Attaching volume 81926e2d-88d1-4976-9859-ac07b1a30dd5 to instance 0ff66242-5c6c-4b03-a642-ab246e0dad46 at mountpoint /dev/vdb on host None. Sep 05 04:45:25 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6629e21c-d9a6-4db9-94c4-a5d10ce262ea tempest-VolumesActionsTest-902818202 None] Attach volume completed successfully. Sep 05 04:45:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6629e21c-d9a6-4db9-94c4-a5d10ce262ea tempest-VolumesActionsTest-902818202 None] Lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5" released by "attach_volume" :: held 0.264s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:45:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff1fbc2b-d44c-4f7e-92aa-14ef963715e2 tempest-VolumesActionsTest-902818202 None] Acquiring lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5-detach_volume" by "detach_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:45:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff1fbc2b-d44c-4f7e-92aa-14ef963715e2 tempest-VolumesActionsTest-902818202 None] Lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:45:25 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ff1fbc2b-d44c-4f7e-92aa-14ef963715e2 tempest-VolumesActionsTest-902818202 None] Detaching volume 81926e2d-88d1-4976-9859-ac07b1a30dd5 from instance 0ff66242-5c6c-4b03-a642-ab246e0dad46. Sep 05 04:45:25 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ff1fbc2b-d44c-4f7e-92aa-14ef963715e2 tempest-VolumesActionsTest-902818202 None] Detach volume completed successfully. Sep 05 04:45:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff1fbc2b-d44c-4f7e-92aa-14ef963715e2 tempest-VolumesActionsTest-902818202 None] Lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5-detach_volume" released by "detach_volume" :: held 0.131s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:45:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "cinder-2aacd9c8-8109-4af0-abc5-562b34170107-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:45:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "cinder-2aacd9c8-8109-4af0-abc5-562b34170107-delete_volume" acquired by "delete_volume" :: waited 0.189s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:45:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "cinder-quobyte-2aacd9c8-8109-4af0-abc5-562b34170107" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:45:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "cinder-quobyte-2aacd9c8-8109-4af0-abc5-562b34170107" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:45:28 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cce8ff-4fa3-4088-9e2d-65664756fa8b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:45:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:28 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107 Sep 05 04:45:28 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:29 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107" returned: 0 in 0.687s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:29 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107 Sep 05 04:45:29 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:29 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2aacd9c8-8109-4af0-abc5-562b34170107" returned: 0 in 0.662s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "cinder-quobyte-2aacd9c8-8109-4af0-abc5-562b34170107" released by "delete_volume" :: held 1.477s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Created reservations ['2342c419-2091-4921-85ea-40c9c735f3eb', 'c9a420b0-9b62-4d90-9744-e41fcc5dcabb', 'd5ae18fa-1c17-486f-98e2-4eead3f5a175', '0abee3ec-42a6-4b92-a544-b6e0578bc660'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:30 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:45:30 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:30 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.346s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:45:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Deleted volume successfully. Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-57cda5d2-cbfb-471a-91d9-320d883eafe9 tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "cinder-2aacd9c8-8109-4af0-abc5-562b34170107-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "cinder-770af7ac-29a3-435c-b8a1-70b5c56f34c8-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "cinder-770af7ac-29a3-435c-b8a1-70b5c56f34c8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "cinder-quobyte-770af7ac-29a3-435c-b8a1-70b5c56f34c8" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "cinder-quobyte-770af7ac-29a3-435c-b8a1-70b5c56f34c8" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[577e37bb-5841-4d07-ab3c-6effb5a112fb]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:45:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:31 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8 Sep 05 04:45:31 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:31 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8" returned: 0 in 0.789s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:31 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8 Sep 05 04:45:31 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:32 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-770af7ac-29a3-435c-b8a1-70b5c56f34c8" returned: 0 in 0.485s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "cinder-quobyte-770af7ac-29a3-435c-b8a1-70b5c56f34c8" released by "delete_volume" :: held 1.332s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Created reservations ['c7b7e7d4-64f5-4b45-90f9-a022e7162b42', '3c7181c0-5d61-412f-9d93-2efd7ed266ea', 'fb7e0759-3b28-4356-8562-6b11971e0920', '111e6e6b-c12b-4285-b907-3bfe027ce815'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:32 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:45:32 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:32 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.323s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:45:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Deleted volume successfully. Sep 05 04:45:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-09682998-3fd6-4e6c-a91e-9a7d1fb4bcde tempest-TestServerVolumeAttachmentScenario-2055509081 None] Lock "cinder-770af7ac-29a3-435c-b8a1-70b5c56f34c8-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:45:40 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:45:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Flow 'volume_create_manager' (3dc83dc9-0cb6-41d9-ac7e-e7b41973b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:45:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc0d97f-846d-4e64-91f3-b56238ce726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc0d97f-846d-4e64-91f3-b56238ce726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1520448095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc385a970e84ae9951f5a1260cb0239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:45:41Z,use_quota=True,user_id='9bf9f806b1584134a50531406f2bc0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383d33bf-6998-4739-9424-50ea1962d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383d33bf-6998-4739-9424-50ea1962d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ae29be-41b1-4b95-881e-44ce9bf099f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ae29be-41b1-4b95-881e-44ce9bf099f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa', 'volume_name': 'volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad70bf00-6643-4d80-a5ab-267c2c98d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad70bf00-6643-4d80-a5ab-267c2c98d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8d80e0-2008-4bd6-8eaa-7021b912da97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Volume 4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa', 'volume_size': 1} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1520448095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc385a970e84ae9951f5a1260cb0239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:45:41Z,use_quota=True,user_id='9bf9f806b1584134a50531406f2bc0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Creating volume 4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:45:41 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:45:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:41 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa 1073741824 Sep 05 04:45:41 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:42 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa 1073741824" returned: 0 in 1.220s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:42 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa Sep 05 04:45:42 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:42 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa" returned: 0 in 0.391s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:45:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8d80e0-2008-4bd6-8eaa-7021b912da97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed6f015-79ae-4c9e-a9bc-f84874344e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:45:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Volume volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa (4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa): created successfully Sep 05 04:45:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed6f015-79ae-4c9e-a9bc-f84874344e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:45:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Flow 'volume_create_manager' (3dc83dc9-0cb6-41d9-ac7e-e7b41973b63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:45:43 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ac499a9a-d245-40b3-a0c7-3ad4b720b42b tempest-TestMinimumBasicScenario-1924651562 None] Created volume successfully. Sep 05 04:45:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b38705e-ba10-4bfc-b449-b36abaca721c tempest-VolumesActionsTest-902818202 None] Acquiring lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5" by "attach_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:45:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b38705e-ba10-4bfc-b449-b36abaca721c tempest-VolumesActionsTest-902818202 None] Lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5" acquired by "attach_volume" :: waited 0.043s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:45:43 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7b38705e-ba10-4bfc-b449-b36abaca721c tempest-VolumesActionsTest-902818202 None] Attaching volume 81926e2d-88d1-4976-9859-ac07b1a30dd5 to instance 4613798c-7191-4e13-b68d-8c52447ced3f at mountpoint /dev/vdb on host None. Sep 05 04:45:43 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7b38705e-ba10-4bfc-b449-b36abaca721c tempest-VolumesActionsTest-902818202 None] Attach volume completed successfully. Sep 05 04:45:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b38705e-ba10-4bfc-b449-b36abaca721c tempest-VolumesActionsTest-902818202 None] Lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5" released by "attach_volume" :: held 0.197s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:45:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-07d39287-0357-4d26-8453-2b0a8f98a7d5 tempest-VolumesActionsTest-902818202 None] Acquiring lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5-detach_volume" by "detach_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:45:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-07d39287-0357-4d26-8453-2b0a8f98a7d5 tempest-VolumesActionsTest-902818202 None] Lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:45:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-07d39287-0357-4d26-8453-2b0a8f98a7d5 tempest-VolumesActionsTest-902818202 None] Detaching volume 81926e2d-88d1-4976-9859-ac07b1a30dd5 from instance 4613798c-7191-4e13-b68d-8c52447ced3f. Sep 05 04:45:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-07d39287-0357-4d26-8453-2b0a8f98a7d5 tempest-VolumesActionsTest-902818202 None] Detach volume completed successfully. Sep 05 04:45:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-07d39287-0357-4d26-8453-2b0a8f98a7d5 tempest-VolumesActionsTest-902818202 None] Lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:45:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-5bde0ac0-75d6-4b4d-af08-ae0cc357e753 req-666c8bdd-e0ac-481c-9acb-f2849214855c tempest-TestMinimumBasicScenario-1924651562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-5bde0ac0-75d6-4b4d-af08-ae0cc357e753 req-666c8bdd-e0ac-481c-9acb-f2849214855c tempest-TestMinimumBasicScenario-1924651562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-5bde0ac0-75d6-4b4d-af08-ae0cc357e753 req-666c8bdd-e0ac-481c-9acb-f2849214855c tempest-TestMinimumBasicScenario-1924651562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:45:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-5bde0ac0-75d6-4b4d-af08-ae0cc357e753 req-666c8bdd-e0ac-481c-9acb-f2849214855c tempest-TestMinimumBasicScenario-1924651562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4daf32d-12e4-4445-8d05-85e0104efcb6', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:45:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-5bde0ac0-75d6-4b4d-af08-ae0cc357e753 req-666c8bdd-e0ac-481c-9acb-f2849214855c tempest-TestMinimumBasicScenario-1924651562 None] attachment_update completed successfully. Sep 05 04:45:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-8100c1ff-c559-44a4-a7aa-722079baa459 req-eac13e0f-35f5-4795-b328-bcc13cc4199d tempest-AttachVolumeTestJSON-947406945 None] Terminate volume connection completed successfully. Sep 05 04:45:46 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-8100c1ff-c559-44a4-a7aa-722079baa459 req-eac13e0f-35f5-4795-b328-bcc13cc4199d tempest-AttachVolumeTestJSON-947406945 None] Deleting attachment 88a5517e-dda6-438e-81ed-b5fd3c93f46e. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:45:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:45:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:45:51 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc905233-1603-489f-af2e-2c0bf115a503]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:45:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:52 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 Sep 05 04:45:52 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:52 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5" returned: 0 in 0.565s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:52 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b9470a-6bc5-4504-8cab-a9d828656eda]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:45:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:52 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 Sep 05 04:45:52 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:53 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 05 04:45:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5" returned: 0 in 0.648s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:45:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.45ae6040-bf33-44b3-8dab-aa1f0ee8b67biot2i097.img {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:45:53 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.45ae6040-bf33-44b3-8dab-aa1f0ee8b67biot2i097.img Sep 05 04:45:53 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:45:56 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=56,cinder:UPDATE=43,cinder:INSERT=8,cinder:DELETE=2 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:46:01 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.45ae6040-bf33-44b3-8dab-aa1f0ee8b67biot2i097.img" returned: 0 in 8.592s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:01 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf8a3bf-ba2d-4e6d-9181-7d6a117e2d96]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:01 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=61,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=3 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:46:02 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 Sep 05 04:46:02 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:02 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5" returned: 0 in 0.846s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:02 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5, size 1024.00 MB, duration 8.59 sec, destination /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.45ae6040-bf33-44b3-8dab-aa1f0ee8b67biot2i097.img {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:46:02 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Converted 1024.00 MB image at 119.17 MB/s Sep 05 04:46:02 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] 45ae6040-bf33-44b3-8dab-aa1f0ee8b67b was raw, no need to convert to raw {{(pid=89807) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 05 04:46:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:46:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:46:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:46:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:46:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:46:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:46:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:10 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:46:10 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:10 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.344s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:46:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:46:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:46:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:46:12 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:46:12 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:46:24 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:46:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.026s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:46:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Uploaded volume to glance image-id: 45ae6040-bf33-44b3-8dab-aa1f0ee8b67b. {{(pid=89807) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 04:46:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-99908bfc-6760-40c0-ab6f-590323c37834 tempest-VolumesActionsTest-902818202 None] Copy volume to image completed successfully. Sep 05 04:46:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:46:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:46:34 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e83e3e-87af-4d9a-b18e-ebe68d55a856]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:35 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 Sep 05 04:46:35 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:35 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5" returned: 0 in 0.410s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:35 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[9188fd26-0558-4c7f-99de-8e2a3f452e54]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:35 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 Sep 05 04:46:35 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:35 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5" returned: 0 in 0.491s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:35 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img Sep 05 04:46:35 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:41 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:46:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Flow 'volume_create_manager' (03239599-beb2-44ee-a004-d5e53c7dd67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:46:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6576820d-36e2-4a13-98d9-37204abc0153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:46:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6576820d-36e2-4a13-98d9-37204abc0153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1153356687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c10059-2677-45a6-879b-5b12aad61c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6abc9b70d1342ddb1dde337527a8f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:46:41Z,use_quota=True,user_id='f1a49e66078f4887ac8b17f5f61bb82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:46:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a15dbc8-f8c5-49ae-9aa2-d41b22e6cf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:46:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a15dbc8-f8c5-49ae-9aa2-d41b22e6cf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:46:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ba8ab3-45f0-4d56-82b4-f4fbfc5b78e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:46:41 devstack cinder-volume[89807]: DEBUG cinder.image.glance [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Creating Keystone auth plugin from conf {{(pid=89807) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 04:46:42 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img" returned: 0 in 6.584s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:42 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[feebce0b-654f-4a3a-add7-f619b9b01b25]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ba8ab3-45f0-4d56-82b4-f4fbfc5b78e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '78c10059-2677-45a6-879b-5b12aad61c60', 'volume_name': 'volume-78c10059-2677-45a6-879b-5b12aad61c60', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:46:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b4052a-484c-461b-a628-8ecac0fd4626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:46:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b4052a-484c-461b-a628-8ecac0fd4626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:46:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6166e74e-dea7-43e2-9cf7-bac9053af6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:46:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Volume 78c10059-2677-45a6-879b-5b12aad61c60: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-78c10059-2677-45a6-879b-5b12aad61c60', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 04:46:42 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Trying to clone 78c10059-2677-45a6-879b-5b12aad61c60 from image d96433d1-6b83-48c1-88e8-5f747cd5fb19 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]). {{(pid=89807) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 04:46:42 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 Sep 05 04:46:42 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:43 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 04:46:43 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Image download 20.69 MB at 20.69 MB/s Sep 05 04:46:43 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0364108-109c-4b25-9afc-9f1582e38ffc]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:43 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5" returned: 0 in 1.155s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:43 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:46:43 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Converted 1024.00 MB image at 155.48 MB/s Sep 05 04:46:43 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] 59467e72-7358-4201-b043-42fb09c01a2f was raw, converting to qcow2 {{(pid=89807) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 05 04:46:43 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD Sep 05 04:46:43 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:43 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8580accd-90d6-47fe-a2a3-347bf05f8436]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:43 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img Sep 05 04:46:43 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:44 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD" returned: 0 in 0.886s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:44 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Temporary image d96433d1-6b83-48c1-88e8-5f747cd5fb19 is fetched for user f1a49e66078f4887ac8b17f5f61bb82c. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 04:46:44 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img" returned: 0 in 0.679s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:44 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e6a57e-c864-456c-a09e-f79ff054824c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:44 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img Sep 05 04:46:44 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:44 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD Sep 05 04:46:44 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:44 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img" returned: 1 in 0.582s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:46:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img /opt/stack/data/cinder/conversion/vol_upload_d2qde3q4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:45 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img /opt/stack/data/cinder/conversion/vol_upload_d2qde3q4 Sep 05 04:46:45 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:45 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD" returned: 0 in 0.844s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:46:45 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img /opt/stack/data/cinder/conversion/vol_upload_d2qde3q4" returned: 0 in 0.614s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:45 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Image conversion details: src /opt/stack/data/cinder/conversion/81926e2d-88d1-4976-9859-ac07b1a30dd5.temp_image.59467e72-7358-4201-b043-42fb09c01a2f816b4cx0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_d2qde3q4 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:46:45 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 05 04:46:45 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[055c7ab1-aef1-4e91-b48b-74b0f4140274]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d2qde3q4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:45 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d2qde3q4 Sep 05 04:46:45 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:46 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d2qde3q4" returned: 0 in 0.519s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:47 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-a878d630-3d84-46d0-93df-646656d0362e req-e3aabd97-b6c7-4937-9544-5b177e8c9046 tempest-TestMinimumBasicScenario-1924651562 None] Terminate volume connection completed successfully. Sep 05 04:46:47 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-a878d630-3d84-46d0-93df-646656d0362e req-e3aabd97-b6c7-4937-9544-5b177e8c9046 tempest-TestMinimumBasicScenario-1924651562 None] Deleting attachment c4daf32d-12e4-4445-8d05-85e0104efcb6. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:46:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Acquiring lock "cinder-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:46:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Lock "cinder-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Acquiring lock "cinder-quobyte-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Lock "cinder-quobyte-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9900fc-5cda-4943-93cb-e5866d7c12dc]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:48 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa Sep 05 04:46:48 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.650s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Uploaded volume to glance image-id: 59467e72-7358-4201-b043-42fb09c01a2f. {{(pid=89807) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.218s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1153356687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c10059-2677-45a6-879b-5b12aad61c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6abc9b70d1342ddb1dde337527a8f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:46:41Z,use_quota=True,user_id='f1a49e66078f4887ac8b17f5f61bb82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Creating volume 78c10059-2677-45a6-879b-5b12aad61c60 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:46:48 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:48 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa" returned: 0 in 0.453s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:48 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 1073741824 Sep 05 04:46:48 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e2d2210f-7ad7-4f4a-9e45-e3e89360d94b tempest-VolumesActionsTest-902818202 None] Copy volume to image completed successfully. Sep 05 04:46:48 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa Sep 05 04:46:48 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:48 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa" returned: 0 in 0.329s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Lock "cinder-quobyte-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa" released by "delete_volume" :: held 0.839s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Created reservations ['1ecbfd96-b465-4b66-8459-4da8b990bfa2', 'd5eff1a7-09ea-4c59-b1b4-44de00a276dc', '0f9198c1-e148-4a13-82a1-711f262ab711', 'a809db34-9575-4a4d-964b-929db7fa9732'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:49 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:46:49 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:49 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 1073741824" returned: 0 in 0.693s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:49 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 Sep 05 04:46:49 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:49 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.501s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:46:49 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Deleted volume successfully. Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-357f26fb-3687-469e-b030-5c74b74f51c9 tempest-TestMinimumBasicScenario-1924651562 None] Lock "cinder-4ce1999e-6820-4316-a6d2-d4c1ef5cd4aa-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:46:49 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60" returned: 0 in 0.469s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Attempting download of d96433d1-6b83-48c1-88e8-5f747cd5fb19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}])) to volume 78c10059-2677-45a6-879b-5b12aad61c60. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e79d58-576f-4923-90c3-4fce26bd5c6a]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_kgiqkbke {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:50 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_kgiqkbke Sep 05 04:46:50 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:50 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_kgiqkbke" returned: 0 in 0.723s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_kgiqkbke {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Acquiring lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:46:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:46:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Acquiring lock "cinder-quobyte-81926e2d-88d1-4976-9859-ac07b1a30dd5" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:46:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Lock "cinder-quobyte-81926e2d-88d1-4976-9859-ac07b1a30dd5" acquired by "delete_volume" :: waited 0.027s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:46:50 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[6398f7aa-62fc-4298-9db6-372a9c041ff7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:50 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_kgiqkbke Sep 05 04:46:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:50 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:50 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 Sep 05 04:46:50 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:51 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_kgiqkbke" returned: 1 in 0.550s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d96433d1-6b83-48c1-88e8-5f747cd5fb19_kgiqkbke' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:46:51 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce16d0fc-2835-435d-82dc-0a19d1ac7fb0]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:46:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:51 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD Sep 05 04:46:51 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:51 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5" returned: 0 in 0.512s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:51 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5 Sep 05 04:46:51 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:51 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD" returned: 0 in 0.568s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:51 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] d96433d1-6b83-48c1-88e8-5f747cd5fb19 was qcow2, converting to qcow2 {{(pid=89807) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 04:46:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:51 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 Sep 05 04:46:51 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:51 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-81926e2d-88d1-4976-9859-ac07b1a30dd5" returned: 0 in 0.636s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Lock "cinder-quobyte-81926e2d-88d1-4976-9859-ac07b1a30dd5" released by "delete_volume" :: held 1.226s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Created reservations ['4d5db0c7-ed02-4113-9e4b-85dbf844e339', 'c7eda00b-9525-4eb1-a5e9-ea9d09980b7f', 'edf3b02d-3cff-40e2-8dba-71b6fae0d2bc', '3026f155-c567-4f58-9d90-4977a085a0da'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:52 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:46:52 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:52 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.414s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:46:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Deleted volume successfully. Sep 05 04:46:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6bbe5fff-91e2-42f1-916c-585540da5e4e tempest-VolumesActionsTest-902818202 None] Lock "cinder-81926e2d-88d1-4976-9859-ac07b1a30dd5-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:46:54 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60" returned: 0 in 2.567s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d96433d1-6b83-48c1-88e8-5f747cd5fb19_p2a7kpf1devstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:46:54 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Converted 112.00 MB image at 43.61 MB/s Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:46:54 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 1G Sep 05 04:46:54 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:46:54 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 1G" returned: 0 in 0.355s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Downloaded image d96433d1-6b83-48c1-88e8-5f747cd5fb19 ((None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}])) to volume 78c10059-2677-45a6-879b-5b12aad61c60 successfully. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Temporary image d96433d1-6b83-48c1-88e8-5f747cd5fb19 for user f1a49e66078f4887ac8b17f5f61bb82c is deleted. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Marking volume 78c10059-2677-45a6-879b-5b12aad61c60 as bootable. {{(pid=89807) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Copying metadata from image d96433d1-6b83-48c1-88e8-5f747cd5fb19 to 78c10059-2677-45a6-879b-5b12aad61c60. {{(pid=89807) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Creating volume glance metadata for volume 78c10059-2677-45a6-879b-5b12aad61c60 backed by image d96433d1-6b83-48c1-88e8-5f747cd5fb19 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89807) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6166e74e-dea7-43e2-9cf7-bac9053af6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c10059-2677-45a6-879b-5b12aad61c60', 'volume_size': 1, 'image_id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd23a198a327a456aa7454655f4c500b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd96433d1-6b83-48c1-88e8-5f747cd5fb19', 'created_at': datetime.datetime(2026, 9, 5, 2, 22, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d96433d1-6b83-48c1-88e8-5f747cd5fb19/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c935a2-5d2f-43db-98b0-102eb6ef8204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:46:54 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Volume volume-78c10059-2677-45a6-879b-5b12aad61c60 (78c10059-2677-45a6-879b-5b12aad61c60): created successfully Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c935a2-5d2f-43db-98b0-102eb6ef8204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:46:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Flow 'volume_create_manager' (03239599-beb2-44ee-a004-d5e53c7dd67e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:46:54 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ea3b5b95-cb9c-4c90-a93c-3536f3d7eeee tempest-TestShelveInstance-1023362614 None] Created volume successfully. Sep 05 04:47:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-de4b3bb5-f10e-47fb-88ad-54ede02100c6 req-9e9810d4-c6b6-4ff0-83e9-cfdeb9c50747 tempest-TestShelveInstance-1023362614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-de4b3bb5-f10e-47fb-88ad-54ede02100c6 req-9e9810d4-c6b6-4ff0-83e9-cfdeb9c50747 tempest-TestShelveInstance-1023362614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-de4b3bb5-f10e-47fb-88ad-54ede02100c6 req-9e9810d4-c6b6-4ff0-83e9-cfdeb9c50747 tempest-TestShelveInstance-1023362614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-de4b3bb5-f10e-47fb-88ad-54ede02100c6 req-9e9810d4-c6b6-4ff0-83e9-cfdeb9c50747 tempest-TestShelveInstance-1023362614 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-78c10059-2677-45a6-879b-5b12aad61c60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e9cd020-6cb2-4f66-a8d1-55005e0c0c79', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:47:01 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-de4b3bb5-f10e-47fb-88ad-54ede02100c6 req-9e9810d4-c6b6-4ff0-83e9-cfdeb9c50747 tempest-TestShelveInstance-1023362614 None] attachment_update completed successfully. Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Flow 'volume_create_manager' (2621fbc1-27e7-435b-b607-3c2335bd48d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82491cf-b7e0-4a13-b84f-8ef11d11dcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82491cf-b7e0-4a13-b84f-8ef11d11dcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-645330294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500a8eef-4406-4362-901d-3ddbc894fd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d23fb3841e443e8b26a6a5a610c0cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:03Z,use_quota=True,user_id='29b28b3f4c4c4c8fa6391766635cb37b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d11e15-1896-4bfa-a801-3b4fb9668b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d11e15-1896-4bfa-a801-3b4fb9668b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdde50b-b5b0-400a-a5a1-3fa86a2754cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdde50b-b5b0-400a-a5a1-3fa86a2754cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '500a8eef-4406-4362-901d-3ddbc894fd50', 'volume_name': 'volume-500a8eef-4406-4362-901d-3ddbc894fd50', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d9b636-d653-483c-9eb8-28985174a8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d9b636-d653-483c-9eb8-28985174a8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4f2c2e-240e-46ac-aec7-d32fab3b332d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:03 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Volume 500a8eef-4406-4362-901d-3ddbc894fd50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-500a8eef-4406-4362-901d-3ddbc894fd50', 'volume_size': 1} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-645330294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500a8eef-4406-4362-901d-3ddbc894fd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d23fb3841e443e8b26a6a5a610c0cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:03Z,use_quota=True,user_id='29b28b3f4c4c4c8fa6391766635cb37b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Creating volume 500a8eef-4406-4362-901d-3ddbc894fd50 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:47:03 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:03 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 1073741824 Sep 05 04:47:03 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:03 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 1073741824" returned: 0 in 0.626s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:04 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 Sep 05 04:47:04 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:04 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50" returned: 0 in 0.402s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:47:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4f2c2e-240e-46ac-aec7-d32fab3b332d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-500a8eef-4406-4362-901d-3ddbc894fd50', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715cc1a1-cf00-449d-aa8d-3929dedb8479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:04 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Volume volume-500a8eef-4406-4362-901d-3ddbc894fd50 (500a8eef-4406-4362-901d-3ddbc894fd50): created successfully Sep 05 04:47:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715cc1a1-cf00-449d-aa8d-3929dedb8479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Flow 'volume_create_manager' (2621fbc1-27e7-435b-b607-3c2335bd48d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:04 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e947203e-239f-49f4-9417-f8da4fedca57 tempest-VolumesCloneTest-1560990690 None] Created volume successfully. Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Flow 'volume_create_manager' (31fa78ee-d745-4d8e-b132-6b9a7bd5a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53637570-0467-4110-9f36-88c58e30d7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53637570-0467-4110-9f36-88c58e30d7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-294718905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8c1da0-1adf-46b4-8320-84809346c661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d23fb3841e443e8b26a6a5a610c0cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=500a8eef-4406-4362-901d-3ddbc894fd50,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:06Z,use_quota=True,user_id='29b28b3f4c4c4c8fa6391766635cb37b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a52c736-5568-4615-8fac-7a61cfd44978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a52c736-5568-4615-8fac-7a61cfd44978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc373c65-6b57-420e-8bd4-587288e619c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc373c65-6b57-420e-8bd4-587288e619c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7b8c1da0-1adf-46b4-8320-84809346c661', 'volume_name': 'volume-7b8c1da0-1adf-46b4-8320-84809346c661', 'volume_size': 2, 'source_volid': '500a8eef-4406-4362-901d-3ddbc894fd50', 'source_volstatus': 'available'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638cf050-0a8f-4a21-b9d9-802ac83664bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638cf050-0a8f-4a21-b9d9-802ac83664bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626c62ac-63fd-46d4-b083-d7c090841559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:06 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Volume 7b8c1da0-1adf-46b4-8320-84809346c661: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7b8c1da0-1adf-46b4-8320-84809346c661', 'volume_size': 2, 'source_volid': '500a8eef-4406-4362-901d-3ddbc894fd50', 'source_volstatus': 'available'} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:06 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Cloning volume 500a8eef-4406-4362-901d-3ddbc894fd50 to volume 7b8c1da0-1adf-46b4-8320-84809346c661 Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Creating offline snapshot a43938d4-a224-443f-8140-89c2aaa155c0 of volume 500a8eef-4406-4362-901d-3ddbc894fd50 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8943b7-2ea4-43ac-8346-0d7d0ead1646]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:06 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 Sep 05 04:47:06 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:07 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50" returned: 0 in 0.676s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:07 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 1G Sep 05 04:47:07 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:07 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 1G" returned: 0 in 0.540s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500a8eef-4406-4362-901d-3ddbc894fd50 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:08 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500a8eef-4406-4362-901d-3ddbc894fd50 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 Sep 05 04:47:08 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:08 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500a8eef-4406-4362-901d-3ddbc894fd50 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0" returned: 0 in 0.704s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:08 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 is being set with open permissions: ugo+rw Sep 05 04:47:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:08 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 Sep 05 04:47:08 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Flow 'volume_create_manager' (27d6a071-23b6-4bb2-a98e-ab168fd0440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca16c4a-01d7-48a7-a468-30a6a60f9a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca16c4a-01d7-48a7-a468-30a6a60f9a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1023651160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef52441f8cc141e1b286fd56aa6c6bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:09Z,use_quota=True,user_id='0964760a6cc746878c08020235cb8cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f557ea9-1a82-40b8-a2cc-5eab63bfdc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f557ea9-1a82-40b8-a2cc-5eab63bfdc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b40cd90-cfdd-4c50-887e-92c3e1e17c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b40cd90-cfdd-4c50-887e-92c3e1e17c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075', 'volume_name': 'volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da33adc-e405-40dc-97a5-967dcc536d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da33adc-e405-40dc-97a5-967dcc536d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f731c613-bfb1-44ea-bd90-e53fb0db5032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:09 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Volume 9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075', 'volume_size': 1} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:09 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0" returned: 0 in 0.530s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:09 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.info Sep 05 04:47:09 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:09 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.info" returned: 0 in 0.402s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:09 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.info is being set with open permissions: ugo+rw Sep 05 04:47:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:09 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.info Sep 05 04:47:09 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:10 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.info" returned: 0 in 0.494s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Acquiring lock "cinder-quobyte-7b8c1da0-1adf-46b4-8320-84809346c661" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Lock "cinder-quobyte-7b8c1da0-1adf-46b4-8320-84809346c661" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] snapshot: a43938d4-a224-443f-8140-89c2aaa155c0, volume: 7b8c1da0-1adf-46b4-8320-84809346c661, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[211ec262-69d8-455b-b1e7-87a381ab1664]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:10 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 Sep 05 04:47:10 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:10 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:47:10 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:10 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0" returned: 0 in 0.715s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-500a8eef-4406-4362-901d-3ddbc894fd50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a581ec40-f847-4daf-a8db-2d388b442908]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:11 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.535s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:47:11 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 Sep 05 04:47:11 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:11 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50" returned: 0 in 0.661s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:47:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:11 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 Sep 05 04:47:11 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=36,cinder:SELECT=37,cinder:INSERT=13,cinder:DELETE=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=36,cinder:INSERT=12,cinder:UPDATE=19,cinder:DELETE=3 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:47:19 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661" returned: 0 in 7.586s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50, size 1024.00 MB, duration 7.59 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:47:19 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Converted 1024.00 MB image at 134.95 MB/s Sep 05 04:47:19 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 is being set with open permissions: ugo+rw Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:19 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 Sep 05 04:47:19 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:19 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661" returned: 0 in 0.322s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Lock "cinder-quobyte-7b8c1da0-1adf-46b4-8320-84809346c661" released by "_copy_volume_from_snapshot" :: held 9.397s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Acquiring lock "cinder-quobyte-a43938d4-a224-443f-8140-89c2aaa155c0" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Lock "cinder-quobyte-a43938d4-a224-443f-8140-89c2aaa155c0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Deleting offline snapshot a43938d4-a224-443f-8140-89c2aaa155c0 of volume 500a8eef-4406-4362-901d-3ddbc894fd50 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] snapshot_file for this snap is: volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1207263-723a-40f1-a2ac-25e5cd551986]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:19 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 Sep 05 04:47:19 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:20 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0" returned: 0 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-500a8eef-4406-4362-901d-3ddbc894fd50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:47:20 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c011edc4-8927-4559-87d3-c7569037bfba]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:20 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 Sep 05 04:47:20 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:20 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50" returned: 0 in 0.888s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:20 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 Sep 05 04:47:20 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:21 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0" returned: 0 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:21 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0 Sep 05 04:47:21 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:21 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50.a43938d4-a224-443f-8140-89c2aaa155c0" returned: 0 in 0.275s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Lock "cinder-quobyte-a43938d4-a224-443f-8140-89c2aaa155c0" released by "_delete_snapshot" :: held 2.008s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.574s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1023651160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef52441f8cc141e1b286fd56aa6c6bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:09Z,use_quota=True,user_id='0964760a6cc746878c08020235cb8cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Creating volume 9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:47:21 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:21 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 1073741824 Sep 05 04:47:21 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626c62ac-63fd-46d4-b083-d7c090841559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8c1da0-1adf-46b4-8320-84809346c661', 'volume_size': 2, 'source_volid': '500a8eef-4406-4362-901d-3ddbc894fd50', 'source_volstatus': 'available'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6242b858-6424-441b-8063-c5c22932bfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:21 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Volume volume-7b8c1da0-1adf-46b4-8320-84809346c661 (7b8c1da0-1adf-46b4-8320-84809346c661): created successfully Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6242b858-6424-441b-8063-c5c22932bfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Flow 'volume_create_manager' (31fa78ee-d745-4d8e-b132-6b9a7bd5a21c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:21 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-2f62ad06-3823-41a0-b80e-c2075d71aa7b tempest-VolumesCloneTest-1560990690 None] Created volume successfully. Sep 05 04:47:22 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 1073741824" returned: 0 in 0.606s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:22 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 Sep 05 04:47:22 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:22 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075" returned: 0 in 0.246s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:47:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f731c613-bfb1-44ea-bd90-e53fb0db5032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef3bf66-fe40-487e-8dd5-7074d1cc3762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:22 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Volume volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 (9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075): created successfully Sep 05 04:47:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef3bf66-fe40-487e-8dd5-7074d1cc3762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Flow 'volume_create_manager' (27d6a071-23b6-4bb2-a98e-ab168fd0440a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:22 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4df600cd-687b-44b1-87e0-61713ce324b2 tempest-AttachVolumeTestJSON-947406945 None] Created volume successfully. Sep 05 04:47:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Acquiring lock "cinder-7b8c1da0-1adf-46b4-8320-84809346c661-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Lock "cinder-7b8c1da0-1adf-46b4-8320-84809346c661-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Acquiring lock "cinder-quobyte-7b8c1da0-1adf-46b4-8320-84809346c661" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Lock "cinder-quobyte-7b8c1da0-1adf-46b4-8320-84809346c661" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:23 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[948db43d-18e7-44e7-90df-3e4be9604032]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:23 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 Sep 05 04:47:23 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-7aba8cef-2750-4bcb-85a3-bd19fb0d2a35 req-222f56b2-e270-4aec-a48a-cbf564a4dfcf tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-7aba8cef-2750-4bcb-85a3-bd19fb0d2a35 req-222f56b2-e270-4aec-a48a-cbf564a4dfcf tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-7aba8cef-2750-4bcb-85a3-bd19fb0d2a35 req-222f56b2-e270-4aec-a48a-cbf564a4dfcf tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-7aba8cef-2750-4bcb-85a3-bd19fb0d2a35 req-222f56b2-e270-4aec-a48a-cbf564a4dfcf tempest-AttachVolumeTestJSON-947406945 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cf90009-61c7-4dd8-9767-48cae896f6ba', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:47:24 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661" returned: 0 in 0.559s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:24 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661 Sep 05 04:47:24 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:24 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-7aba8cef-2750-4bcb-85a3-bd19fb0d2a35 req-222f56b2-e270-4aec-a48a-cbf564a4dfcf tempest-AttachVolumeTestJSON-947406945 None] attachment_update completed successfully. Sep 05 04:47:24 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-7b8c1da0-1adf-46b4-8320-84809346c661" returned: 0 in 0.301s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Lock "cinder-quobyte-7b8c1da0-1adf-46b4-8320-84809346c661" released by "delete_volume" :: held 0.934s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Created reservations ['ac642a35-492f-4412-9d51-e396f1f2a0fd', '600804f7-f22f-4b41-acd9-db11b4882108', 'bef07b71-c988-4063-97a1-54da9ac61f66', '68e15257-d5f3-4a03-a01c-b510df0e3652'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:24 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:47:24 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:25 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.382s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:25 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:47:25 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Deleted volume successfully. Sep 05 04:47:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dca67fe4-1690-4357-b789-b8b77ac440cf tempest-VolumesCloneTest-1560990690 None] Lock "cinder-7b8c1da0-1adf-46b4-8320-84809346c661-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Acquiring lock "cinder-500a8eef-4406-4362-901d-3ddbc894fd50-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Lock "cinder-500a8eef-4406-4362-901d-3ddbc894fd50-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Acquiring lock "cinder-quobyte-500a8eef-4406-4362-901d-3ddbc894fd50" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Lock "cinder-quobyte-500a8eef-4406-4362-901d-3ddbc894fd50" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:26 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[319ffee8-b7db-425a-9fb8-c70d7b781886]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:26 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 Sep 05 04:47:26 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:26 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50" returned: 0 in 0.498s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:26 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50 Sep 05 04:47:26 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:27 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-500a8eef-4406-4362-901d-3ddbc894fd50" returned: 0 in 0.459s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Lock "cinder-quobyte-500a8eef-4406-4362-901d-3ddbc894fd50" released by "delete_volume" :: held 1.098s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Flow 'volume_create_manager' (fc0ecf6c-e51b-42df-9dd7-791e0052e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05daca9-fdfa-46cf-adb1-540b4fdc6a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05daca9-fdfa-46cf-adb1-540b4fdc6a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1553987835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6467fb-ece4-4eff-bca3-296752c17925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef52441f8cc141e1b286fd56aa6c6bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:27Z,use_quota=True,user_id='0964760a6cc746878c08020235cb8cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e99ec7e-becb-4820-bba8-4516d59d6d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e99ec7e-becb-4820-bba8-4516d59d6d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25647758-287f-4629-9620-dced1122b3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25647758-287f-4629-9620-dced1122b3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e6467fb-ece4-4eff-bca3-296752c17925', 'volume_name': 'volume-9e6467fb-ece4-4eff-bca3-296752c17925', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71c5a5a-0a78-49f6-a340-c613cf110feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71c5a5a-0a78-49f6-a340-c613cf110feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef2cdb8-f2aa-4407-9ab5-4402109500f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:27 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Volume 9e6467fb-ece4-4eff-bca3-296752c17925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e6467fb-ece4-4eff-bca3-296752c17925', 'volume_size': 1} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1553987835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6467fb-ece4-4eff-bca3-296752c17925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef52441f8cc141e1b286fd56aa6c6bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:27Z,use_quota=True,user_id='0964760a6cc746878c08020235cb8cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Creating volume 9e6467fb-ece4-4eff-bca3-296752c17925 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:47:27 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:27 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925 1073741824 Sep 05 04:47:27 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Created reservations ['5ba406bd-c863-4505-9e35-638911486fbc', '48e977a1-6891-4bae-9c25-0005bac9cb98', '5ee48c0f-96f8-420c-9eb0-2ec0a0a40461', '5c7a3cc3-a7fe-4bcd-9c9a-b011bf0a2aec'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:27 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:47:27 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:27 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.259s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:47:27 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Deleted volume successfully. Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0d38c75b-5bbc-41f5-af9d-3bddd8c55615 tempest-VolumesCloneTest-1560990690 None] Lock "cinder-500a8eef-4406-4362-901d-3ddbc894fd50-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:27 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925 1073741824" returned: 0 in 0.504s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:27 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925 Sep 05 04:47:27 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:28 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925" returned: 0 in 0.278s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:47:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef2cdb8-f2aa-4407-9ab5-4402109500f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e6467fb-ece4-4eff-bca3-296752c17925', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6a55fa-3482-421d-bf32-d9f7e772efb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:28 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Volume volume-9e6467fb-ece4-4eff-bca3-296752c17925 (9e6467fb-ece4-4eff-bca3-296752c17925): created successfully Sep 05 04:47:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6a55fa-3482-421d-bf32-d9f7e772efb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Flow 'volume_create_manager' (fc0ecf6c-e51b-42df-9dd7-791e0052e75d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:28 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-626b427e-cae4-4ee5-945d-41902f37cc8b tempest-AttachVolumeTestJSON-947406945 None] Created volume successfully. Sep 05 04:47:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-99400645-5d28-4707-b661-fcdc0f23c9ab req-b73b7ef9-b722-4187-bdb5-63179c39a703 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-99400645-5d28-4707-b661-fcdc0f23c9ab req-b73b7ef9-b722-4187-bdb5-63179c39a703 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-99400645-5d28-4707-b661-fcdc0f23c9ab req-b73b7ef9-b722-4187-bdb5-63179c39a703 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-99400645-5d28-4707-b661-fcdc0f23c9ab req-b73b7ef9-b722-4187-bdb5-63179c39a703 tempest-AttachVolumeTestJSON-947406945 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-9e6467fb-ece4-4eff-bca3-296752c17925', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9add9bb0-73a4-461a-954b-f381f1c7d00c', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:47:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-99400645-5d28-4707-b661-fcdc0f23c9ab req-b73b7ef9-b722-4187-bdb5-63179c39a703 tempest-AttachVolumeTestJSON-947406945 None] attachment_update completed successfully. Sep 05 04:47:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-971a5d8a-921f-4350-8cde-1ed91f373a62 req-b7d61310-d215-4693-a823-960b6d08e074 tempest-AttachVolumeTestJSON-947406945 None] Terminate volume connection completed successfully. Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-971a5d8a-921f-4350-8cde-1ed91f373a62 req-b7d61310-d215-4693-a823-960b6d08e074 tempest-AttachVolumeTestJSON-947406945 None] Deleting attachment 2cf90009-61c7-4dd8-9767-48cae896f6ba. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Flow 'volume_create_manager' (91be6b82-0884-43c4-bca8-36382de5517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479613d1-4e4a-40df-9bcc-aad851701b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479613d1-4e4a-40df-9bcc-aad851701b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-8005503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f89dcf-1ecb-461e-a334-3da04a6e56cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e435a2d59a7473c99c740b7903e4de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:33Z,use_quota=True,user_id='36807367f2dc4f4d8249585e4515f1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48545e49-5bb7-4da7-8c44-cdcc7e696926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48545e49-5bb7-4da7-8c44-cdcc7e696926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89c4ab9-5062-406e-a927-01325fe14edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89c4ab9-5062-406e-a927-01325fe14edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f89dcf-1ecb-461e-a334-3da04a6e56cc', 'volume_name': 'volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f37c54a-04c7-46d2-ba93-56952c6c0aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f37c54a-04c7-46d2-ba93-56952c6c0aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9053ed30-114b-4135-8f78-a827e31cac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:32 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Volume 84f89dcf-1ecb-461e-a334-3da04a6e56cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc', 'volume_size': 1} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-8005503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f89dcf-1ecb-461e-a334-3da04a6e56cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e435a2d59a7473c99c740b7903e4de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:33Z,use_quota=True,user_id='36807367f2dc4f4d8249585e4515f1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Creating volume 84f89dcf-1ecb-461e-a334-3da04a6e56cc {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:47:32 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:47:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:32 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc 1073741824 Sep 05 04:47:32 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:33 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc 1073741824" returned: 0 in 0.741s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:33 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc Sep 05 04:47:33 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:33 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-01db1203-e02c-40cf-a107-8402b97a6057 req-da6e4950-421a-4888-8cc5-f05d0c1a60f3 tempest-AttachVolumeTestJSON-947406945 None] Terminate volume connection completed successfully. Sep 05 04:47:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-01db1203-e02c-40cf-a107-8402b97a6057 req-da6e4950-421a-4888-8cc5-f05d0c1a60f3 tempest-AttachVolumeTestJSON-947406945 None] Deleting attachment 9add9bb0-73a4-461a-954b-f381f1c7d00c. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:47:33 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc" returned: 0 in 0.288s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:47:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9053ed30-114b-4135-8f78-a827e31cac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcd6e40-6171-4c06-a02a-1e658a3c7172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:34 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Volume volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc (84f89dcf-1ecb-461e-a334-3da04a6e56cc): created successfully Sep 05 04:47:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcd6e40-6171-4c06-a02a-1e658a3c7172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Flow 'volume_create_manager' (91be6b82-0884-43c4-bca8-36382de5517e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:34 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c6723863-9068-43c9-9560-035e6f5a0a6d tempest-VolumesListTestJSON-341683328 None] Created volume successfully. Sep 05 04:47:35 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Flow 'volume_create_manager' (14cbbafc-7d14-472d-8dac-aac0c060850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3e99c3-a0e3-441b-8bfb-0f554e412ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3e99c3-a0e3-441b-8bfb-0f554e412ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1562898898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d62c1f-9412-48ca-bc2a-501acddbabab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e435a2d59a7473c99c740b7903e4de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:36Z,use_quota=True,user_id='36807367f2dc4f4d8249585e4515f1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e435aac-2b16-4e1f-aca4-a8cc68b16064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e435aac-2b16-4e1f-aca4-a8cc68b16064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085c2e08-138b-4811-8948-5ec1e51f463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085c2e08-138b-4811-8948-5ec1e51f463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d62c1f-9412-48ca-bc2a-501acddbabab', 'volume_name': 'volume-a7d62c1f-9412-48ca-bc2a-501acddbabab', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e16c50-6ecd-45b7-ae02-dcc66e3bec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e16c50-6ecd-45b7-ae02-dcc66e3bec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d5f84a-66fc-4954-ba99-cd5c21d04000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:36 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Volume a7d62c1f-9412-48ca-bc2a-501acddbabab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d62c1f-9412-48ca-bc2a-501acddbabab', 'volume_size': 1} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1562898898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d62c1f-9412-48ca-bc2a-501acddbabab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e435a2d59a7473c99c740b7903e4de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:36Z,use_quota=True,user_id='36807367f2dc4f4d8249585e4515f1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Creating volume a7d62c1f-9412-48ca-bc2a-501acddbabab {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:47:36 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:36 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab 1073741824 Sep 05 04:47:36 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:36 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab 1073741824" returned: 0 in 0.710s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:36 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab Sep 05 04:47:36 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:37 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab" returned: 0 in 0.326s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:47:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d5f84a-66fc-4954-ba99-cd5c21d04000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d62c1f-9412-48ca-bc2a-501acddbabab', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8fbd5a-3f1d-46b0-9aee-18a247fe9406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:37 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Volume volume-a7d62c1f-9412-48ca-bc2a-501acddbabab (a7d62c1f-9412-48ca-bc2a-501acddbabab): created successfully Sep 05 04:47:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8fbd5a-3f1d-46b0-9aee-18a247fe9406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Flow 'volume_create_manager' (14cbbafc-7d14-472d-8dac-aac0c060850a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-183f5c8a-f77a-459f-a03e-d5da40e93244 tempest-VolumesListTestJSON-341683328 None] Created volume successfully. Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Flow 'volume_create_manager' (183282ff-1b5f-41ce-8815-c97569f638f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023292f8-08f3-4c12-9699-f11b751d849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023292f8-08f3-4c12-9699-f11b751d849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1801576046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762a49b4-b546-4ad7-8f5f-4e5590cdea61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e435a2d59a7473c99c740b7903e4de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:38Z,use_quota=True,user_id='36807367f2dc4f4d8249585e4515f1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c97e60-7e95-40b9-b077-d54ba1fdbcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c97e60-7e95-40b9-b077-d54ba1fdbcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4118c4aa-c50b-42c3-97f8-e7f964234254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4118c4aa-c50b-42c3-97f8-e7f964234254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762a49b4-b546-4ad7-8f5f-4e5590cdea61', 'volume_name': 'volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca4ea4c-862a-42e9-b5a8-4217598eaef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca4ea4c-862a-42e9-b5a8-4217598eaef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cd098e-8ce5-49cb-91a9-d5aa3ae3649d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:38 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Volume 762a49b4-b546-4ad7-8f5f-4e5590cdea61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61', 'volume_size': 1} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1801576046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762a49b4-b546-4ad7-8f5f-4e5590cdea61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e435a2d59a7473c99c740b7903e4de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:47:38Z,use_quota=True,user_id='36807367f2dc4f4d8249585e4515f1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Creating volume 762a49b4-b546-4ad7-8f5f-4e5590cdea61 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:47:38 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:47:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:38 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61 1073741824 Sep 05 04:47:38 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:39 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61 1073741824" returned: 0 in 0.678s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:39 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61 Sep 05 04:47:39 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:39 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61" returned: 0 in 0.331s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:47:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cd098e-8ce5-49cb-91a9-d5aa3ae3649d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552af750-f89d-4022-bb5f-19d19e963ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:47:39 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Volume volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61 (762a49b4-b546-4ad7-8f5f-4e5590cdea61): created successfully Sep 05 04:47:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552af750-f89d-4022-bb5f-19d19e963ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:47:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Flow 'volume_create_manager' (183282ff-1b5f-41ce-8815-c97569f638f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:47:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5b671b19-e7cb-4292-bed0-14620d0090ee tempest-VolumesListTestJSON-341683328 None] Created volume successfully. Sep 05 04:47:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "cinder-9e6467fb-ece4-4eff-bca3-296752c17925-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-9e6467fb-ece4-4eff-bca3-296752c17925-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "cinder-quobyte-9e6467fb-ece4-4eff-bca3-296752c17925" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-quobyte-9e6467fb-ece4-4eff-bca3-296752c17925" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:40 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[592e7780-e460-45dd-adfd-f7e873fe0fa9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:40 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925 Sep 05 04:47:40 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:41 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925" returned: 0 in 0.452s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:41 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925 Sep 05 04:47:41 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:41 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e6467fb-ece4-4eff-bca3-296752c17925" returned: 0 in 0.333s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-quobyte-9e6467fb-ece4-4eff-bca3-296752c17925" released by "delete_volume" :: held 0.901s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:41 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Created reservations ['581eebfe-e361-4365-b3d6-aad9365cc488', '8daab524-ad16-4666-99a5-8db0a380360c', 'b82518ef-f4fc-424b-9e59-9ab2d75b53b1', 'b3c63384-ea31-4ffc-8c3a-6fc134a9a857'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:47:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:42 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:47:42 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-5f11f3dc-00bd-465a-aac3-7d707cd205a6 req-213634e1-6879-45fd-bacd-e6f25bc70924 tempest-TestShelveInstance-1023362614 None] Terminate volume connection completed successfully. Sep 05 04:47:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-5f11f3dc-00bd-465a-aac3-7d707cd205a6 req-213634e1-6879-45fd-bacd-e6f25bc70924 tempest-TestShelveInstance-1023362614 None] Deleting attachment 3e9cd020-6cb2-4f66-a8d1-55005e0c0c79. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:47:42 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.442s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:42 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:47:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Deleted volume successfully. Sep 05 04:47:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1e0fd233-a24c-4d5a-9071-6d8afe8d4292 tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-9e6467fb-ece4-4eff-bca3-296752c17925-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "cinder-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "cinder-quobyte-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-quobyte-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:43 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1c3f8c-9e60-446b-a356-828d3c66ba5c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:43 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 Sep 05 04:47:43 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:43 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075" returned: 0 in 0.520s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:43 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075 Sep 05 04:47:43 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:44 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075" returned: 0 in 0.338s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-quobyte-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075" released by "delete_volume" :: held 0.909s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Created reservations ['8be8c00e-5b6a-4d8d-b134-0782ee081548', '67979b95-d974-4091-b616-88e126a5edb0', 'cada0d05-8126-409d-a0b4-5a80f4857b62', '1f224b65-6756-461e-ac82-d56fb40d23da'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:44 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:47:44 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "cinder-762a49b4-b546-4ad7-8f5f-4e5590cdea61-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-762a49b4-b546-4ad7-8f5f-4e5590cdea61-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "cinder-quobyte-762a49b4-b546-4ad7-8f5f-4e5590cdea61" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-quobyte-762a49b4-b546-4ad7-8f5f-4e5590cdea61" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:44 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.441s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:47:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Deleted volume successfully. Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb8ff0b-e1a0-47d7-8406-c6f064ab48be]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d65a483e-c71c-4b33-88ed-d1f7a1ef8c72 tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-9544e1b8-5d6c-4b7b-8ba6-fbc906fbd075-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:44 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61 Sep 05 04:47:44 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:45 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61" returned: 0 in 0.440s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-80623093-04e2-4eac-8d8b-dbcd37a0b456 req-d3922716-17f1-4fa8-bb54-0ea2457da267 tempest-TestShelveInstance-1023362614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-80623093-04e2-4eac-8d8b-dbcd37a0b456 req-d3922716-17f1-4fa8-bb54-0ea2457da267 tempest-TestShelveInstance-1023362614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:45 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61 Sep 05 04:47:45 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-80623093-04e2-4eac-8d8b-dbcd37a0b456 req-d3922716-17f1-4fa8-bb54-0ea2457da267 tempest-TestShelveInstance-1023362614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-80623093-04e2-4eac-8d8b-dbcd37a0b456 req-d3922716-17f1-4fa8-bb54-0ea2457da267 tempest-TestShelveInstance-1023362614 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-78c10059-2677-45a6-879b-5b12aad61c60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fa06922-acc8-40ae-8bce-93be332c3da2', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:47:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-80623093-04e2-4eac-8d8b-dbcd37a0b456 req-d3922716-17f1-4fa8-bb54-0ea2457da267 tempest-TestShelveInstance-1023362614 None] attachment_update completed successfully. Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "cinder-598e5897-798d-4389-8f00-e99b57f20819-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-598e5897-798d-4389-8f00-e99b57f20819-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:45 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-762a49b4-b546-4ad7-8f5f-4e5590cdea61" returned: 0 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "cinder-quobyte-598e5897-798d-4389-8f00-e99b57f20819" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-quobyte-762a49b4-b546-4ad7-8f5f-4e5590cdea61" released by "delete_volume" :: held 0.904s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-quobyte-598e5897-798d-4389-8f00-e99b57f20819" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb2ba5d-1160-4417-84c8-6d220bb00ecd]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Created reservations ['83c7b7ef-4ce6-4967-9dc7-a060f44a40f7', 'bc49859f-6ebf-4613-9649-f927e57ca95a', '4a564443-a3a6-4897-8ef7-0fbea87287ed', 'e66888e5-d4fc-4353-96b6-1bbe87487e96'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:45 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819 Sep 05 04:47:45 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:45 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:47:45 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:46 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.320s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:46 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819" returned: 0 in 0.527s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Deleted volume successfully. Sep 05 04:47:46 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819 Sep 05 04:47:46 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-87814fe8-bcc8-4c0a-b30a-977ff0a719c6 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-762a49b4-b546-4ad7-8f5f-4e5590cdea61-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:46 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-598e5897-798d-4389-8f00-e99b57f20819" returned: 0 in 0.286s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-quobyte-598e5897-798d-4389-8f00-e99b57f20819" released by "delete_volume" :: held 0.886s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Created reservations ['0459ec2c-fed3-4298-a4b7-fdd9d6e51a1d', '40c1329e-6848-42cf-a507-f204724e565f', '297c6f73-f77c-433e-b654-905858d2b725', 'a8a615ad-cbbd-4ab1-b884-baa7f714a1b8'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:46 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:47:46 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "cinder-a7d62c1f-9412-48ca-bc2a-501acddbabab-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-a7d62c1f-9412-48ca-bc2a-501acddbabab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:47 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.439s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:47:47 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Deleted volume successfully. Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "cinder-quobyte-a7d62c1f-9412-48ca-bc2a-501acddbabab" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c2477446-b0de-48b3-ab6b-ee50bc0ae73c tempest-AttachVolumeTestJSON-947406945 None] Lock "cinder-598e5897-798d-4389-8f00-e99b57f20819-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-quobyte-a7d62c1f-9412-48ca-bc2a-501acddbabab" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f87bfb-5d60-42c7-83e5-bfc0a1fb8599]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:47 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab Sep 05 04:47:47 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:47 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab" returned: 0 in 0.583s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:47 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab Sep 05 04:47:47 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:48 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a7d62c1f-9412-48ca-bc2a-501acddbabab" returned: 0 in 0.400s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-quobyte-a7d62c1f-9412-48ca-bc2a-501acddbabab" released by "delete_volume" :: held 1.049s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Created reservations ['9ff7f73a-8b76-46f6-8ab6-37f888a1c91c', 'cc4c78da-4052-4f55-8478-b8d8b0672331', '1ba14f34-7971-4511-aa6e-3807fb0752a5', '28997065-a864-42ff-80af-7f62caede583'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:48 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:47:48 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:48 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.347s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:47:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Deleted volume successfully. Sep 05 04:47:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97ce9f7a-6d46-4f19-8ab3-2cee67560142 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-a7d62c1f-9412-48ca-bc2a-501acddbabab-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "cinder-84f89dcf-1ecb-461e-a334-3da04a6e56cc-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-84f89dcf-1ecb-461e-a334-3da04a6e56cc-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "cinder-quobyte-84f89dcf-1ecb-461e-a334-3da04a6e56cc" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:47:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-quobyte-84f89dcf-1ecb-461e-a334-3da04a6e56cc" acquired by "delete_volume" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:47:49 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[73575065-e1b1-4300-88fa-63d7fdaf645b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:47:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:50 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc Sep 05 04:47:50 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:50 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc" returned: 0 in 0.666s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:50 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc Sep 05 04:47:50 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:51 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-84f89dcf-1ecb-461e-a334-3da04a6e56cc" returned: 0 in 0.460s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-quobyte-84f89dcf-1ecb-461e-a334-3da04a6e56cc" released by "delete_volume" :: held 1.206s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Created reservations ['b8372d45-2f17-47fc-a087-0242d783ee88', '9b8a9141-3d85-4076-a11f-c528abe3ef1a', '2803b0cd-134c-43b7-9b64-db94431c96c4', '0759e67e-19c9-472e-acf5-27aa88e62d56'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:47:51 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:47:51 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:47:51 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.328s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:47:51 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Deleted volume successfully. Sep 05 04:47:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ffb6d782-385f-43ee-afc1-b11c17816a70 tempest-VolumesListTestJSON-341683328 None] Lock "cinder-84f89dcf-1ecb-461e-a334-3da04a6e56cc-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Flow 'volume_create_manager' (9cb6e3ae-b6f7-4882-96e9-2ce7d85c54b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976d6c8c-0b02-4266-9374-0d72b6230c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976d6c8c-0b02-4266-9374-0d72b6230c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-914946197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0650c3e-8395-46be-adf8-6be6dc93bcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c2c9fb8e614e14b98a4c59aad6c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:00Z,use_quota=True,user_id='9314b18e08dc49b1985d98c80f2b6fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044e37cb-e0f2-4655-9d96-99baae799f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044e37cb-e0f2-4655-9d96-99baae799f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa80c898-d5e7-4d84-b8af-6c08aace990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa80c898-d5e7-4d84-b8af-6c08aace990c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0650c3e-8395-46be-adf8-6be6dc93bcab', 'volume_name': 'volume-a0650c3e-8395-46be-adf8-6be6dc93bcab', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3878cc-a97b-412b-b8f7-30a20b2bd0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3878cc-a97b-412b-b8f7-30a20b2bd0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9b6817-a79f-4d77-87fb-8b1a1ec5e99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:00 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Volume a0650c3e-8395-46be-adf8-6be6dc93bcab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0650c3e-8395-46be-adf8-6be6dc93bcab', 'volume_size': 1} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-914946197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0650c3e-8395-46be-adf8-6be6dc93bcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c2c9fb8e614e14b98a4c59aad6c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:00Z,use_quota=True,user_id='9314b18e08dc49b1985d98c80f2b6fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Creating volume a0650c3e-8395-46be-adf8-6be6dc93bcab {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:48:00 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:48:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:00 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab 1073741824 Sep 05 04:48:00 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:01 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab 1073741824" returned: 0 in 0.870s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:01 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab Sep 05 04:48:01 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:02 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab" returned: 0 in 0.537s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:48:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9b6817-a79f-4d77-87fb-8b1a1ec5e99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0650c3e-8395-46be-adf8-6be6dc93bcab', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9952179f-0edd-4661-9e25-cf03d3cf39b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:02 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Volume volume-a0650c3e-8395-46be-adf8-6be6dc93bcab (a0650c3e-8395-46be-adf8-6be6dc93bcab): created successfully Sep 05 04:48:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9952179f-0edd-4661-9e25-cf03d3cf39b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Flow 'volume_create_manager' (9cb6e3ae-b6f7-4882-96e9-2ce7d85c54b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:02 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-29f625dd-3aee-4164-8355-579c812d2431 tempest-VolumesNegativeTest-349262512 None] Created volume successfully. Sep 05 04:48:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:48:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:10 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:48:10 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:11 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.474s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:48:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:48:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:48:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:48:12 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=87,cinder:SELECT=72,cinder:INSERT=25,cinder:DELETE=9 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:48:12 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=92,cinder:SELECT=77,cinder:INSERT=14,cinder:DELETE=6 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:48:22 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:48:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Flow 'volume_create_manager' (8480e7e9-fec9-460f-a3ef-187132c3490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d82bfe1-a17d-4843-a9c3-835191deb7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d82bfe1-a17d-4843-a9c3-835191deb7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1087437844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1bc747-3e61-492a-bc16-51cead26e192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a7027eff7f4fb994e7c9e01a46823e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:23Z,use_quota=True,user_id='4a01fc1dba744476a075025b32bb2310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349a762a-7f56-4c40-ae54-ccc957a12bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349a762a-7f56-4c40-ae54-ccc957a12bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87caf681-ba23-4c75-8271-d66be8b3bafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87caf681-ba23-4c75-8271-d66be8b3bafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c1bc747-3e61-492a-bc16-51cead26e192', 'volume_name': 'volume-5c1bc747-3e61-492a-bc16-51cead26e192', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98549879-8315-4f98-b1f3-9278c97c0321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98549879-8315-4f98-b1f3-9278c97c0321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c171a6-3fae-4345-a6f7-0f59be315a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:23 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Volume 5c1bc747-3e61-492a-bc16-51cead26e192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c1bc747-3e61-492a-bc16-51cead26e192', 'volume_size': 1} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1087437844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1bc747-3e61-492a-bc16-51cead26e192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a7027eff7f4fb994e7c9e01a46823e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:23Z,use_quota=True,user_id='4a01fc1dba744476a075025b32bb2310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Creating volume 5c1bc747-3e61-492a-bc16-51cead26e192 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:48:23 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:23 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192 1073741824 Sep 05 04:48:23 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:23 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192 1073741824" returned: 0 in 0.590s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:23 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192 Sep 05 04:48:23 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:24 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192" returned: 0 in 0.440s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:48:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c171a6-3fae-4345-a6f7-0f59be315a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c1bc747-3e61-492a-bc16-51cead26e192', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39180e76-ad25-456f-8985-ee1f7acdb848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:24 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Volume volume-5c1bc747-3e61-492a-bc16-51cead26e192 (5c1bc747-3e61-492a-bc16-51cead26e192): created successfully Sep 05 04:48:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39180e76-ad25-456f-8985-ee1f7acdb848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Flow 'volume_create_manager' (8480e7e9-fec9-460f-a3ef-187132c3490e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:24 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7c8ce64d-22a1-4dd5-b122-4d2aed6b8719 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Created volume successfully. Sep 05 04:48:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-4da823cc-f49e-4364-ab4d-3eec96cb4c7e req-9baf63a1-3a22-4181-a672-9f77ce987ebd tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-4da823cc-f49e-4364-ab4d-3eec96cb4c7e req-9baf63a1-3a22-4181-a672-9f77ce987ebd tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-4da823cc-f49e-4364-ab4d-3eec96cb4c7e req-9baf63a1-3a22-4181-a672-9f77ce987ebd tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.065s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-4da823cc-f49e-4364-ab4d-3eec96cb4c7e req-9baf63a1-3a22-4181-a672-9f77ce987ebd tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-5c1bc747-3e61-492a-bc16-51cead26e192', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c948fe8b-f53b-4761-ad11-be44dfd9d214', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:48:26 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-4da823cc-f49e-4364-ab4d-3eec96cb4c7e req-9baf63a1-3a22-4181-a672-9f77ce987ebd tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] attachment_update completed successfully. Sep 05 04:48:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Acquiring lock "cinder-a0650c3e-8395-46be-adf8-6be6dc93bcab-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Lock "cinder-a0650c3e-8395-46be-adf8-6be6dc93bcab-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Acquiring lock "cinder-quobyte-a0650c3e-8395-46be-adf8-6be6dc93bcab" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Lock "cinder-quobyte-a0650c3e-8395-46be-adf8-6be6dc93bcab" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:29 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc856458-f7b6-47e3-999b-94e47abcc7f4]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:48:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:29 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab Sep 05 04:48:29 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:29 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab" returned: 0 in 0.505s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-e539b47a-3247-46a0-8140-0373c5534604 req-fcaed3b7-a303-491c-b7e3-c86cebf12dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Terminate volume connection completed successfully. Sep 05 04:48:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-e539b47a-3247-46a0-8140-0373c5534604 req-fcaed3b7-a303-491c-b7e3-c86cebf12dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Deleting attachment c948fe8b-f53b-4761-ad11-be44dfd9d214. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:48:29 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab Sep 05 04:48:29 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:30 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a0650c3e-8395-46be-adf8-6be6dc93bcab" returned: 0 in 0.396s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Lock "cinder-quobyte-a0650c3e-8395-46be-adf8-6be6dc93bcab" released by "delete_volume" :: held 0.999s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Created reservations ['0184978f-02c5-41c6-91d0-4b4f2b1e7599', 'a82a9710-b78f-4be3-be7e-8ec8cebfdb51', 'dae0dfa9-6d8f-426b-a618-7e73867da536', '4a8a7c79-c97e-4bc6-abdf-4d89c126482c'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:30 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:48:30 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Acquiring lock "cinder-5c1bc747-3e61-492a-bc16-51cead26e192-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "cinder-5c1bc747-3e61-492a-bc16-51cead26e192-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:30 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.275s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:48:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Deleted volume successfully. Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Acquiring lock "cinder-quobyte-5c1bc747-3e61-492a-bc16-51cead26e192" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-008f9802-24b4-4142-9f81-52b457fc7d92 tempest-VolumesNegativeTest-349262512 None] Lock "cinder-a0650c3e-8395-46be-adf8-6be6dc93bcab-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "cinder-quobyte-5c1bc747-3e61-492a-bc16-51cead26e192" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bc2b14-72e7-4a95-99a0-3a7b6292bd18]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:48:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:30 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192 Sep 05 04:48:30 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:31 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:31 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192 Sep 05 04:48:31 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:31 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5c1bc747-3e61-492a-bc16-51cead26e192" returned: 0 in 0.339s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "cinder-quobyte-5c1bc747-3e61-492a-bc16-51cead26e192" released by "delete_volume" :: held 0.799s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Created reservations ['42294f16-c19a-43e7-a876-4dad052785ce', '099f69e5-cdac-4e17-8e42-074cb5ef20c7', 'b15add8b-8633-4aef-bf12-7131a0d4a9ce', '8ddaa7ca-f51e-4115-a250-a1713ffc4c7e'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:31 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:48:31 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:32 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.615s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:32 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:48:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Deleted volume successfully. Sep 05 04:48:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7cf090df-76a5-4cbd-8376-70d9e553f9a4 tempest-TestServerVolumeAttachScenarioOldVersion-1627168036 None] Lock "cinder-5c1bc747-3e61-492a-bc16-51cead26e192-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:36 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-976d1c11-e822-4bf3-94b7-6c8f6266405f tempest-TestShelveInstance-1023362614 None] Terminate volume connection completed successfully. Sep 05 04:48:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-976d1c11-e822-4bf3-94b7-6c8f6266405f tempest-TestShelveInstance-1023362614 None] Deleting attachment 8fa06922-acc8-40ae-8bce-93be332c3da2. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:48:36 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:48:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Flow 'volume_create_manager' (e3f6648b-7e62-4e39-9516-1765f695a5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba569d42-539b-44ef-b122-a8fac1bb4009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Acquiring lock "cinder-78c10059-2677-45a6-879b-5b12aad61c60-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba569d42-539b-44ef-b122-a8fac1bb4009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1831462772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ec5d84-6f23-4f3a-8ec5-4905e597b4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669dee2db1d412d9608f9760162f021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:37Z,use_quota=True,user_id='c0074ebc53c4402ca8f69c1211edbf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac25327-c154-4414-bf81-8d06d32daeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac25327-c154-4414-bf81-8d06d32daeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d711b49-f977-40c5-a36f-2603ea585a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d711b49-f977-40c5-a36f-2603ea585a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ec5d84-6f23-4f3a-8ec5-4905e597b4d0', 'volume_name': 'volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ef1ab4-d25b-4a09-9363-0a046ecea6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ef1ab4-d25b-4a09-9363-0a046ecea6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f100ca1-1b2f-44c7-8878-9ccaf2b3a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:37 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Volume 63ec5d84-6f23-4f3a-8ec5-4905e597b4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0', 'volume_size': 1} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1831462772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ec5d84-6f23-4f3a-8ec5-4905e597b4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669dee2db1d412d9608f9760162f021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:37Z,use_quota=True,user_id='c0074ebc53c4402ca8f69c1211edbf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Creating volume 63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:48:37 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Lock "cinder-78c10059-2677-45a6-879b-5b12aad61c60-delete_volume" acquired by "delete_volume" :: waited 0.163s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:37 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 1073741824 Sep 05 04:48:37 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Acquiring lock "cinder-quobyte-78c10059-2677-45a6-879b-5b12aad61c60" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Lock "cinder-quobyte-78c10059-2677-45a6-879b-5b12aad61c60" acquired by "delete_volume" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8d20ba-082e-48ec-a4ad-f0e5c02ef3bf]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:48:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:37 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 Sep 05 04:48:37 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Flow 'volume_create_manager' (f2ca5b44-8796-42f6-80e5-881812f84270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df46cf26-eb87-4152-8214-84a611bad5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df46cf26-eb87-4152-8214-84a611bad5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-775785301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b788d87c-e166-4471-93d6-879de6808551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669dee2db1d412d9608f9760162f021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:38Z,use_quota=True,user_id='c0074ebc53c4402ca8f69c1211edbf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a8a008-2f27-4e7f-af39-849d25907986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a8a008-2f27-4e7f-af39-849d25907986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b626d7e-2bd5-432b-991b-fc83a64fa988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b626d7e-2bd5-432b-991b-fc83a64fa988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b788d87c-e166-4471-93d6-879de6808551', 'volume_name': 'volume-b788d87c-e166-4471-93d6-879de6808551', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d768ce0b-38dc-44b9-90a0-d091a6ee73d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d768ce0b-38dc-44b9-90a0-d091a6ee73d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:38 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5dba935-1cae-4c70-8c1f-8a87f206873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:38 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Volume b788d87c-e166-4471-93d6-879de6808551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b788d87c-e166-4471-93d6-879de6808551', 'volume_size': 1} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60" returned: 0 in 1.028s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:38 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60 Sep 05 04:48:38 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:38 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 1073741824" returned: 0 in 1.421s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Flow 'volume_create_manager' (3513e24e-3c93-4c37-a2e9-6c9210cf3fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72497719-01b3-4c37-a48d-a96681dcf62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72497719-01b3-4c37-a48d-a96681dcf62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1372483725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8358f6-0a4f-45db-b70e-fa3d43bc9572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669dee2db1d412d9608f9760162f021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:38Z,use_quota=True,user_id='c0074ebc53c4402ca8f69c1211edbf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afae0666-e18d-4b91-b659-5d43724cbc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afae0666-e18d-4b91-b659-5d43724cbc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d80df6b-f927-4943-9eed-5323548ece2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:38 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d80df6b-f927-4943-9eed-5323548ece2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8358f6-0a4f-45db-b70e-fa3d43bc9572', 'volume_name': 'volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:38 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c32d55-82a2-4ff4-bc4b-1873c096ebee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c32d55-82a2-4ff4-bc4b-1873c096ebee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:38 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123ab560-187b-43a8-88ef-fafcb0caeb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:38 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Volume 2b8358f6-0a4f-45db-b70e-fa3d43bc9572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572', 'volume_size': 1} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-78c10059-2677-45a6-879b-5b12aad61c60" returned: 0 in 0.461s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Lock "cinder-quobyte-78c10059-2677-45a6-879b-5b12aad61c60" released by "delete_volume" :: held 1.618s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:38 devstack cinder-volume[89807]: DEBUG cinder.quota [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Created reservations ['9089c95a-bda2-4735-be77-f1c94edf353b', 'ccbfcab2-8c07-4c2e-a281-51ea211355b5', '253654cd-5f3d-41d0-b6d0-ee9d4a2f07c0', '1940d908-e052-4f8e-80b0-aedba74b96d9'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:39 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0" returned: 0 in 0.589s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:39 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:48:39 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-775785301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b788d87c-e166-4471-93d6-879de6808551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669dee2db1d412d9608f9760162f021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:38Z,use_quota=True,user_id='c0074ebc53c4402ca8f69c1211edbf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Creating volume b788d87c-e166-4471-93d6-879de6808551 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:48:39 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:39 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551 1073741824 Sep 05 04:48:39 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f100ca1-1b2f-44c7-8878-9ccaf2b3a54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a4e5f5-f051-4e86-8f04-7ec941609e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:39 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Volume volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 (63ec5d84-6f23-4f3a-8ec5-4905e597b4d0): created successfully Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a4e5f5-f051-4e86-8f04-7ec941609e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Flow 'volume_create_manager' (e3f6648b-7e62-4e39-9516-1765f695a5e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Flow 'volume_create_manager' (17227d1a-6787-49a7-9350-98bbea9f9cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad7823f-ebea-4da4-960d-5c9a93a400e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-adca345b-f08f-48b0-b87e-4ae21cefc50a tempest-CreateVolumesFromImageTest-574935945 None] Created volume successfully. Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad7823f-ebea-4da4-960d-5c9a93a400e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-660381094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4664b2f-05c8-41a5-91d5-1b0373d1de8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669dee2db1d412d9608f9760162f021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:39Z,use_quota=True,user_id='c0074ebc53c4402ca8f69c1211edbf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454ea826-938b-44e0-907e-0d69d205da1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454ea826-938b-44e0-907e-0d69d205da1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bedcb6e-8c13-4cde-a3b7-95d369840a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:39 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bedcb6e-8c13-4cde-a3b7-95d369840a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4664b2f-05c8-41a5-91d5-1b0373d1de8e', 'volume_name': 'volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50150d0-12b6-4329-91e8-513bed60de75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50150d0-12b6-4329-91e8-513bed60de75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e8ca20-365e-456c-ab81-2af078b92f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:39 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Volume a4664b2f-05c8-41a5-91d5-1b0373d1de8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e', 'volume_size': 1} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.716s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.manager [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:48:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Deleted volume successfully. Sep 05 04:48:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [req-1289bf13-bd5b-4dce-a533-8b49592587c8 req-abf13fe8-0750-48f4-9c99-1e077d14db92 tempest-TestShelveInstance-1023362614 None] Lock "cinder-78c10059-2677-45a6-879b-5b12aad61c60-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Flow 'volume_create_manager' (45822849-ab02-4f92-b589-419eb91d3f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb17ab7-420c-45c3-ad0a-87c336e94cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb17ab7-420c-45c3-ad0a-87c336e94cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1127760078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f64daa9-6aa3-43e5-9054-7cea42fe187c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669dee2db1d412d9608f9760162f021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:40Z,use_quota=True,user_id='c0074ebc53c4402ca8f69c1211edbf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ca6483-c5e4-4150-868f-0b0ef914e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ca6483-c5e4-4150-868f-0b0ef914e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a26e87-d68f-4636-a007-f045e5763198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a26e87-d68f-4636-a007-f045e5763198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f64daa9-6aa3-43e5-9054-7cea42fe187c', 'volume_name': 'volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54be83af-32f6-41ff-9bd2-e35762cf1074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54be83af-32f6-41ff-9bd2-e35762cf1074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:40 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b85a01-0310-414f-b940-698183494b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:40 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Volume 9f64daa9-6aa3-43e5-9054-7cea42fe187c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c', 'volume_size': 1} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551 1073741824" returned: 0 in 1.106s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:40 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551 Sep 05 04:48:40 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:40 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551" returned: 0 in 0.352s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1372483725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8358f6-0a4f-45db-b70e-fa3d43bc9572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669dee2db1d412d9608f9760162f021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:38Z,use_quota=True,user_id='c0074ebc53c4402ca8f69c1211edbf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Creating volume 2b8358f6-0a4f-45db-b70e-fa3d43bc9572 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:48:40 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:40 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572 1073741824 Sep 05 04:48:40 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5dba935-1cae-4c70-8c1f-8a87f206873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b788d87c-e166-4471-93d6-879de6808551', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893be743-2ca3-470b-8d8a-d64ee8fb0ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:40 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Volume volume-b788d87c-e166-4471-93d6-879de6808551 (b788d87c-e166-4471-93d6-879de6808551): created successfully Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893be743-2ca3-470b-8d8a-d64ee8fb0ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Flow 'volume_create_manager' (f2ca5b44-8796-42f6-80e5-881812f84270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:40 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a1e74a25-d534-4080-a2ff-afb70026f67f tempest-CreateVolumesFromImageTest-574935945 None] Created volume successfully. Sep 05 04:48:41 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572 1073741824" returned: 0 in 0.567s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:41 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572 Sep 05 04:48:41 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:41 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572" returned: 0 in 0.294s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.879s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-660381094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4664b2f-05c8-41a5-91d5-1b0373d1de8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669dee2db1d412d9608f9760162f021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:39Z,use_quota=True,user_id='c0074ebc53c4402ca8f69c1211edbf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Creating volume a4664b2f-05c8-41a5-91d5-1b0373d1de8e {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:48:41 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123ab560-187b-43a8-88ef-fafcb0caeb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:41 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e 1073741824 Sep 05 04:48:41 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48336c44-809b-4028-8377-d912f91cf280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Volume volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572 (2b8358f6-0a4f-45db-b70e-fa3d43bc9572): created successfully Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48336c44-809b-4028-8377-d912f91cf280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Flow 'volume_create_manager' (3513e24e-3c93-4c37-a2e9-6c9210cf3fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:41 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1b820aaf-2e7b-4790-b599-507d6b526db8 tempest-CreateVolumesFromImageTest-574935945 None] Created volume successfully. Sep 05 04:48:42 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e 1073741824" returned: 0 in 0.508s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:42 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e Sep 05 04:48:42 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:42 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e" returned: 0 in 0.309s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.185s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1127760078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f64daa9-6aa3-43e5-9054-7cea42fe187c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669dee2db1d412d9608f9760162f021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:40Z,use_quota=True,user_id='c0074ebc53c4402ca8f69c1211edbf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Creating volume 9f64daa9-6aa3-43e5-9054-7cea42fe187c {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:48:42 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:42 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c 1073741824 Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e8ca20-365e-456c-ab81-2af078b92f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:42 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9e005c-067c-429f-bc68-09e806b8b687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Volume volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e (a4664b2f-05c8-41a5-91d5-1b0373d1de8e): created successfully Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9e005c-067c-429f-bc68-09e806b8b687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Flow 'volume_create_manager' (17227d1a-6787-49a7-9350-98bbea9f9cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7d82fcce-482f-49e0-856c-c81cca0e516a tempest-CreateVolumesFromImageTest-574935945 None] Created volume successfully. Sep 05 04:48:43 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c 1073741824" returned: 0 in 0.492s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:43 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c Sep 05 04:48:43 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:43 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c" returned: 0 in 0.250s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b85a01-0310-414f-b940-698183494b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf5fec6-ab2a-4498-a17a-b2489aa933ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:43 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Volume volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c (9f64daa9-6aa3-43e5-9054-7cea42fe187c): created successfully Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf5fec6-ab2a-4498-a17a-b2489aa933ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Flow 'volume_create_manager' (45822849-ab02-4f92-b589-419eb91d3f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:43 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6cb79589-db5f-4b28-9ba5-07cc7aa59d44 tempest-CreateVolumesFromImageTest-574935945 None] Created volume successfully. Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "cinder-9f64daa9-6aa3-43e5-9054-7cea42fe187c-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-9f64daa9-6aa3-43e5-9054-7cea42fe187c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "cinder-quobyte-9f64daa9-6aa3-43e5-9054-7cea42fe187c" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-quobyte-9f64daa9-6aa3-43e5-9054-7cea42fe187c" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c0c59b-b298-4a67-b435-ea76052582d7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:48:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:44 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c Sep 05 04:48:44 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:44 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c" returned: 0 in 0.459s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:44 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c Sep 05 04:48:44 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:44 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f64daa9-6aa3-43e5-9054-7cea42fe187c" returned: 0 in 0.314s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-quobyte-9f64daa9-6aa3-43e5-9054-7cea42fe187c" released by "delete_volume" :: held 0.821s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Created reservations ['44d62c0a-8260-4f0c-9069-aea5316d72bb', '7a82bd66-9874-476c-82fb-f168572e40f1', 'c2815023-88ac-42e8-a4f1-525c87317c88', '88ac19a0-e4e4-41b4-9d12-6e3a79440e02'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:44 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:48:44 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "cinder-a4664b2f-05c8-41a5-91d5-1b0373d1de8e-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-a4664b2f-05c8-41a5-91d5-1b0373d1de8e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "cinder-quobyte-a4664b2f-05c8-41a5-91d5-1b0373d1de8e" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-quobyte-a4664b2f-05c8-41a5-91d5-1b0373d1de8e" acquired by "delete_volume" :: waited 0.027s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0dafbe-3071-49a5-9af4-a7653be9fd1d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:45 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.391s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:48:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Deleted volume successfully. Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0c0ca597-e420-4cf8-b320-73138cf1bb7a tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-9f64daa9-6aa3-43e5-9054-7cea42fe187c-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:45 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e Sep 05 04:48:45 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:45 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e" returned: 0 in 0.443s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:45 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e Sep 05 04:48:45 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:45 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a4664b2f-05c8-41a5-91d5-1b0373d1de8e" returned: 0 in 0.292s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-quobyte-a4664b2f-05c8-41a5-91d5-1b0373d1de8e" released by "delete_volume" :: held 0.808s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:45 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Created reservations ['044227d8-1056-42d0-a8dd-92aadd13a729', '68fe6d37-6abf-48aa-8be3-c3979490efe7', '900f8a8c-031a-45d1-a659-91aa353d7a76', '2f85146a-e214-4dd6-9847-d17de760641a'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:46 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:48:46 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "cinder-2b8358f6-0a4f-45db-b70e-fa3d43bc9572-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-2b8358f6-0a4f-45db-b70e-fa3d43bc9572-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "cinder-quobyte-2b8358f6-0a4f-45db-b70e-fa3d43bc9572" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-quobyte-2b8358f6-0a4f-45db-b70e-fa3d43bc9572" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d4e65a-ed13-4e75-a06a-516acda6085c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:46 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.357s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:48:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Deleted volume successfully. Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c4c28bfe-ac6a-4d86-b616-44be89b136f4 tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-a4664b2f-05c8-41a5-91d5-1b0373d1de8e-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:46 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572 Sep 05 04:48:46 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:46 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572" returned: 0 in 0.500s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:46 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572 Sep 05 04:48:46 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:47 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-2b8358f6-0a4f-45db-b70e-fa3d43bc9572" returned: 0 in 0.301s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-quobyte-2b8358f6-0a4f-45db-b70e-fa3d43bc9572" released by "delete_volume" :: held 0.862s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Created reservations ['ea7aeaf4-2ff2-460a-9064-1b8b0b9713c8', '85d71144-9e09-4c70-b3a8-5b41f6527ed4', 'd85a10a0-0e42-41fa-8786-1e8898429105', '7df7361d-9370-47b5-ba2b-f1f14490d685'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:47 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:48:47 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "cinder-b788d87c-e166-4471-93d6-879de6808551-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-b788d87c-e166-4471-93d6-879de6808551-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "cinder-quobyte-b788d87c-e166-4471-93d6-879de6808551" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-quobyte-b788d87c-e166-4471-93d6-879de6808551" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfeb2a9-01f4-4443-9a27-6db25da1a929]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:47 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:47 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551 Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:48:47 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:47 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Deleted volume successfully. Sep 05 04:48:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ef187988-16a5-4811-8acb-117248057b1f tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-2b8358f6-0a4f-45db-b70e-fa3d43bc9572-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:48 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551" returned: 0 in 0.470s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:48 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551 Sep 05 04:48:48 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:48 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b788d87c-e166-4471-93d6-879de6808551" returned: 0 in 0.248s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-quobyte-b788d87c-e166-4471-93d6-879de6808551" released by "delete_volume" :: held 0.762s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Created reservations ['9fffbac5-51cf-4b00-9342-b11b9cb71312', 'a6d920d1-927f-4409-ad26-eca8871364e4', '49bea578-37cc-4efb-a02e-c9726078b88f', 'c7ba4418-2917-4fcb-bd00-c77402389c6a'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:48 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:48:48 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "cinder-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "cinder-quobyte-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-quobyte-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8de19-5e7d-4c41-9b6b-779ec3e45bca]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:48 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.320s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:48:48 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Deleted volume successfully. Sep 05 04:48:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3b730d89-cf33-4204-b725-a73ef5101eeb tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-b788d87c-e166-4471-93d6-879de6808551-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:48 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 Sep 05 04:48:48 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:49 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0" returned: 0 in 0.511s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:49 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0 Sep 05 04:48:49 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:49 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0" returned: 0 in 0.437s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-quobyte-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0" released by "delete_volume" :: held 1.003s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Created reservations ['a14361e1-efd9-4b97-a56d-59b3aa3576a6', '37f7c34b-1c7d-4320-a952-b5887a42890a', 'c2908073-510b-4de1-ab6d-619d25a838b6', '3da4a83f-047e-4eb6-8f4b-a2497c34dbf2'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:49 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:48:49 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:50 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.349s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:50 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:48:50 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Deleted volume successfully. Sep 05 04:48:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0cb1e7ed-34a9-499f-b883-39387cce739e tempest-CreateVolumesFromImageTest-574935945 None] Lock "cinder-63ec5d84-6f23-4f3a-8ec5-4905e597b4d0-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Flow 'volume_create_manager' (b50cbbbc-affe-410f-a675-9448fb0aa576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1f56cf-cce5-4a26-943a-70487fddf1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1f56cf-cce5-4a26-943a-70487fddf1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-284287572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ffd940-d8e8-47cd-9e0e-78904902c384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8f15735d6849599f6d4cb1b7d52500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:53Z,use_quota=True,user_id='886e0cc81aff46cea32d725d8daf0a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c929134-c552-41da-b68a-6fb1b37c6761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c929134-c552-41da-b68a-6fb1b37c6761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d88742f-0825-440d-ac3a-cd54c72b7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d88742f-0825-440d-ac3a-cd54c72b7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ffd940-d8e8-47cd-9e0e-78904902c384', 'volume_name': 'volume-55ffd940-d8e8-47cd-9e0e-78904902c384', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1db676-2309-4017-9b69-a9b6e6593a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1db676-2309-4017-9b69-a9b6e6593a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b130a9ff-9c57-4f77-8180-a120bce56c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:53 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Volume 55ffd940-d8e8-47cd-9e0e-78904902c384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ffd940-d8e8-47cd-9e0e-78904902c384', 'volume_size': 1} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-284287572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ffd940-d8e8-47cd-9e0e-78904902c384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8f15735d6849599f6d4cb1b7d52500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:53Z,use_quota=True,user_id='886e0cc81aff46cea32d725d8daf0a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Creating volume 55ffd940-d8e8-47cd-9e0e-78904902c384 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:48:53 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:53 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384 1073741824 Sep 05 04:48:53 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:53 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384 1073741824" returned: 0 in 0.551s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:53 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384 Sep 05 04:48:53 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:54 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384" returned: 0 in 0.293s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:48:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b130a9ff-9c57-4f77-8180-a120bce56c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ffd940-d8e8-47cd-9e0e-78904902c384', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198e8b1c-26eb-4d1f-b87b-dee7734a05bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:54 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Volume volume-55ffd940-d8e8-47cd-9e0e-78904902c384 (55ffd940-d8e8-47cd-9e0e-78904902c384): created successfully Sep 05 04:48:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198e8b1c-26eb-4d1f-b87b-dee7734a05bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Flow 'volume_create_manager' (b50cbbbc-affe-410f-a675-9448fb0aa576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:54 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1374901f-0374-4bb5-8527-ec0e6160903e tempest-AttachVolumeNegativeTest-340087041 None] Created volume successfully. Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Flow 'volume_create_manager' (c1c48727-ce93-467e-9afd-d05baff4d2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea60192-f04b-4656-be8e-4632314566ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea60192-f04b-4656-be8e-4632314566ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1182d0ce-62f3-44aa-bebf-61c35b6666b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cda34f65da4a84a52ba75018bacb2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:56Z,use_quota=True,user_id='9922b91c88e74c0a957b3eb5e51ab5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4310bb71-0e11-4519-a054-dfae16c78bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4310bb71-0e11-4519-a054-dfae16c78bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37d7207-60a0-4c90-ae4f-befa6a0d2be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37d7207-60a0-4c90-ae4f-befa6a0d2be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1182d0ce-62f3-44aa-bebf-61c35b6666b2', 'volume_name': 'volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0dbd8c-463b-4e87-a8fc-ad4a342cb7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0dbd8c-463b-4e87-a8fc-ad4a342cb7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6c1115-4f0c-4a37-acca-846aa1647e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:55 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Volume 1182d0ce-62f3-44aa-bebf-61c35b6666b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2', 'volume_size': 1} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1182d0ce-62f3-44aa-bebf-61c35b6666b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cda34f65da4a84a52ba75018bacb2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:56Z,use_quota=True,user_id='9922b91c88e74c0a957b3eb5e51ab5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Creating volume 1182d0ce-62f3-44aa-bebf-61c35b6666b2 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:48:55 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:48:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:55 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2 1073741824 Sep 05 04:48:56 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-5dbd6217-b9a8-4831-b569-b6e577d8b988 req-de751392-8508-4461-95b9-663d775d6860 tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:56 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2 1073741824" returned: 0 in 0.593s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:56 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2 Sep 05 04:48:56 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:56 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2" returned: 0 in 0.369s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:48:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-5dbd6217-b9a8-4831-b569-b6e577d8b988 req-de751392-8508-4461-95b9-663d775d6860 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.618s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6c1115-4f0c-4a37-acca-846aa1647e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a0080f-ccd7-463b-87df-6cd6ead1c331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-5dbd6217-b9a8-4831-b569-b6e577d8b988 req-de751392-8508-4461-95b9-663d775d6860 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:57 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Volume volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2 (1182d0ce-62f3-44aa-bebf-61c35b6666b2): created successfully Sep 05 04:48:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a0080f-ccd7-463b-87df-6cd6ead1c331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Flow 'volume_create_manager' (c1c48727-ce93-467e-9afd-d05baff4d2cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c85e4e72-c457-4a21-b17a-2c441043bd61 tempest-CinderUnicodeTest-523574672 None] Created volume successfully. Sep 05 04:48:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-5dbd6217-b9a8-4831-b569-b6e577d8b988 req-de751392-8508-4461-95b9-663d775d6860 tempest-AttachVolumeNegativeTest-340087041 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-55ffd940-d8e8-47cd-9e0e-78904902c384', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15e4ac70-dca0-41e5-8879-cb52c8b15b60', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:48:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-5dbd6217-b9a8-4831-b569-b6e577d8b988 req-de751392-8508-4461-95b9-663d775d6860 tempest-AttachVolumeNegativeTest-340087041 None] attachment_update completed successfully. Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Flow 'volume_create_manager' (0beb0bb3-36e6-4fbe-a1b7-8b8decc31d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c209f2-0085-4f8a-bb52-37b6be8d2758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c209f2-0085-4f8a-bb52-37b6be8d2758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-700168763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d911f782-026b-4691-b04a-798d5124f9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cda34f65da4a84a52ba75018bacb2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:59Z,use_quota=True,user_id='9922b91c88e74c0a957b3eb5e51ab5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0de834-3d4e-4919-8af8-5e21f842c27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0de834-3d4e-4919-8af8-5e21f842c27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359b5a7d-289f-428a-b7e7-28add9c791c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359b5a7d-289f-428a-b7e7-28add9c791c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd911f782-026b-4691-b04a-798d5124f9a4', 'volume_name': 'volume-d911f782-026b-4691-b04a-798d5124f9a4', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a45c06-accf-4510-bda9-097cff93a5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a45c06-accf-4510-bda9-097cff93a5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7ac4b1-529a-4913-95dc-bfe6bb1e4404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:58 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Volume d911f782-026b-4691-b04a-798d5124f9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d911f782-026b-4691-b04a-798d5124f9a4', 'volume_size': 1} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:48:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-700168763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d911f782-026b-4691-b04a-798d5124f9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cda34f65da4a84a52ba75018bacb2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:48:59Z,use_quota=True,user_id='9922b91c88e74c0a957b3eb5e51ab5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Creating volume d911f782-026b-4691-b04a-798d5124f9a4 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:48:58 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:48:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:58 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 1073741824 Sep 05 04:48:58 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:59 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 1073741824" returned: 0 in 0.604s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:48:59 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 Sep 05 04:48:59 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:48:59 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 05 04:48:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4" returned: 0 in 0.405s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:48:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:48:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:48:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7ac4b1-529a-4913-95dc-bfe6bb1e4404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d911f782-026b-4691-b04a-798d5124f9a4', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7b3704-fcae-48ab-9ccd-3199de5b232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:48:59 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Volume volume-d911f782-026b-4691-b04a-798d5124f9a4 (d911f782-026b-4691-b04a-798d5124f9a4): created successfully Sep 05 04:48:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7b3704-fcae-48ab-9ccd-3199de5b232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:48:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Flow 'volume_create_manager' (0beb0bb3-36e6-4fbe-a1b7-8b8decc31d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:00 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-712b0056-9907-4b61-94e5-aace88979723 tempest-CinderUnicodeTest-523574672 None] Created volume successfully. Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Flow 'volume_create_manager' (dea99472-eb08-4651-b227-8e7feb34bd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c635b24-beaa-406b-afa6-450031cd02da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c635b24-beaa-406b-afa6-450031cd02da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23743fc135f14e5b827da377d54d0a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:00Z,use_quota=True,user_id='9d81a4a4ca064fe2b9088a2dc2da09b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2a7b82a-14ea-46cf-ad74-766c7e6ef1c0),volume_type_id=e2a7b82a-14ea-46cf-ad74-766c7e6ef1c0)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4462707-6dc2-45d1-a516-5e380dc49ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4462707-6dc2-45d1-a516-5e380dc49ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72df753b-9fc9-427e-b2b5-4702843ed90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.image.glance [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Creating Keystone auth plugin from conf {{(pid=89807) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72df753b-9fc9-427e-b2b5-4702843ed90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe', 'volume_name': 'volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe', 'volume_size': 1, 'image_id': '178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47ad22b1e18d157eedb5d39c9aac61b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23743fc135f14e5b827da377d54d0a08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9fa7a91927102e48afd83a64ded370c30255f3ded5317705c1867af6c54d10665a328a091ba2b61f11c93714ff36c7cbf8eb71d90476d0176b20b0c241b4a17', 'id': '178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'created_at': datetime.datetime(2026, 9, 5, 2, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/178addee-e09e-40af-8ab3-1f6ddf0e1e95/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5501871b-1337-4111-9f41-1f941c0130d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5501871b-1337-4111-9f41-1f941c0130d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cff37e-fa0a-4393-a21d-34817c254405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:00 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Volume 9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe', 'volume_size': 1, 'image_id': '178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47ad22b1e18d157eedb5d39c9aac61b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23743fc135f14e5b827da377d54d0a08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9fa7a91927102e48afd83a64ded370c30255f3ded5317705c1867af6c54d10665a328a091ba2b61f11c93714ff36c7cbf8eb71d90476d0176b20b0c241b4a17', 'id': '178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'created_at': datetime.datetime(2026, 9, 5, 2, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/178addee-e09e-40af-8ab3-1f6ddf0e1e95/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 05 04:49:00 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Trying to clone 9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe from image 178addee-e09e-40af-8ab3-1f6ddf0e1e95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'metadata': {}}]). {{(pid=89807) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 04:49:01 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Image download 0.00 MB at 0.00 MB/s Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e0185-e78e-4435-bb32-d12da80eebd7]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Creating offline snapshot 386b0cc3-e902-44af-9f6d-396e5eed0c89 of volume d911f782-026b-4691-b04a-798d5124f9a4 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[75091873-cad6-417c-bd9e-57df1d40a69c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:01 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD Sep 05 04:49:01 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:01 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 Sep 05 04:49:01 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:01 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD" returned: 0 in 0.581s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:01 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4" returned: 0 in 0.662s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:01 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 1G Sep 05 04:49:01 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:02 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD Sep 05 04:49:02 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:02 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD" returned: 1 in 0.461s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:49:02 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Temporary image 178addee-e09e-40af-8ab3-1f6ddf0e1e95 is fetched for user 9d81a4a4ca064fe2b9088a2dc2da09b9. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 04:49:02 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6205e9-5ceb-4df9-8a02-3c687c47c665]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:02 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD Sep 05 04:49:02 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:02 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 1G" returned: 0 in 0.710s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d911f782-026b-4691-b04a-798d5124f9a4 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:02 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d911f782-026b-4691-b04a-798d5124f9a4 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 Sep 05 04:49:02 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:02 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD" returned: 0 in 0.430s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:03 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD Sep 05 04:49:03 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:03 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d911f782-026b-4691-b04a-798d5124f9a4 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89" returned: 0 in 0.415s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:03 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 is being set with open permissions: ugo+rw Sep 05 04:49:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:03 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 Sep 05 04:49:03 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:03 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD" returned: 1 in 0.460s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:49:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:03 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89" returned: 0 in 0.324s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:03 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.info Sep 05 04:49:03 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:03 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.info" returned: 0 in 0.408s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:03 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.info is being set with open permissions: ugo+rw Sep 05 04:49:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:03 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.info Sep 05 04:49:03 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:04 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.info" returned: 0 in 0.320s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.985s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23743fc135f14e5b827da377d54d0a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:00Z,use_quota=True,user_id='9d81a4a4ca064fe2b9088a2dc2da09b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2a7b82a-14ea-46cf-ad74-766c7e6ef1c0),volume_type_id=e2a7b82a-14ea-46cf-ad74-766c7e6ef1c0)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Creating volume 9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:49:04 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:04 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe 1073741824 Sep 05 04:49:04 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:04 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8254d1e4-d424-4f54-9437-1e0c8e647862 tempest-CinderUnicodeTest-523574672 None] Create snapshot completed successfully Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "cinder-386b0cc3-e902-44af-9f6d-396e5eed0c89-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-386b0cc3-e902-44af-9f6d-396e5eed0c89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "cinder-quobyte-d911f782-026b-4691-b04a-798d5124f9a4" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-quobyte-d911f782-026b-4691-b04a-798d5124f9a4" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "cinder-quobyte-386b0cc3-e902-44af-9f6d-396e5eed0c89" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-quobyte-386b0cc3-e902-44af-9f6d-396e5eed0c89" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Deleting offline snapshot 386b0cc3-e902-44af-9f6d-396e5eed0c89 of volume d911f782-026b-4691-b04a-798d5124f9a4 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] snapshot_file for this snap is: volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcd8c93-ba30-4239-877e-3d9f6f2d6c9f]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:04 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 Sep 05 04:49:04 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:05 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe 1073741824" returned: 0 in 0.983s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:05 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:05 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe Sep 05 04:49:05 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89" returned: 0 in 0.683s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d911f782-026b-4691-b04a-798d5124f9a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d02c07-a4fb-4387-83e3-ca7720e1f1a0]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:05 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 Sep 05 04:49:05 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:05 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe" returned: 0 in 0.432s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Attempting download of 178addee-e09e-40af-8ab3-1f6ddf0e1e95 ((None, [{'url': 'file:///opt/stack/data/glance/images/178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'metadata': {}}])) to volume 9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0378c0f2-4a96-4943-89f0-eac6bafe7ee9]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_178addee-e09e-40af-8ab3-1f6ddf0e1e95_84zi65uv {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:05 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4" returned: 0 in 0.518s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:06 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_178addee-e09e-40af-8ab3-1f6ddf0e1e95_84zi65uv Sep 05 04:49:06 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:06 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 Sep 05 04:49:06 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:06 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_178addee-e09e-40af-8ab3-1f6ddf0e1e95_84zi65uv" returned: 0 in 0.411s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_178addee-e09e-40af-8ab3-1f6ddf0e1e95_84zi65uv {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:06 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:06 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_178addee-e09e-40af-8ab3-1f6ddf0e1e95_84zi65uv Sep 05 04:49:06 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89" returned: 0 in 0.409s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:06 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89 Sep 05 04:49:06 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:06 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4.386b0cc3-e902-44af-9f6d-396e5eed0c89" returned: 0 in 0.302s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:06 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-quobyte-386b0cc3-e902-44af-9f6d-396e5eed0c89" released by "_delete_snapshot" :: held 2.136s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_178addee-e09e-40af-8ab3-1f6ddf0e1e95_84zi65uv" returned: 1 in 0.528s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_178addee-e09e-40af-8ab3-1f6ddf0e1e95_84zi65uv' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dee6383-b2ac-4fc6-84e4-7b4b5a097cad]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-quobyte-d911f782-026b-4691-b04a-798d5124f9a4" released by "delete_snapshot" :: held 2.184s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Created reservations ['dac7c4cf-8bb7-4d23-af6f-b8a45b885ed6', '3c3f9862-77e6-4485-922d-d32b549c87f4', '42728479-3418-4d77-8d5a-d95721716b11', 'e1d85ac1-ecd5-4821-8a3d-12f721ba9388'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:49:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Delete snapshot completed successfully. Sep 05 04:49:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a7ebcb34-e9b4-40c9-aed2-da7550d7d321 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-386b0cc3-e902-44af-9f6d-396e5eed0c89-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:06 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD Sep 05 04:49:06 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:07 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD" returned: 0 in 0.494s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:07 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD Sep 05 04:49:07 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:07 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD" returned: 1 in 0.630s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:49:07 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] 178addee-e09e-40af-8ab3-1f6ddf0e1e95 was raw, converting to qcow2 {{(pid=89807) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 04:49:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "cinder-d911f782-026b-4691-b04a-798d5124f9a4-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:08 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe Sep 05 04:49:08 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-d911f782-026b-4691-b04a-798d5124f9a4-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "cinder-quobyte-d911f782-026b-4691-b04a-798d5124f9a4" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-quobyte-d911f782-026b-4691-b04a-798d5124f9a4" acquired by "delete_volume" :: waited 0.068s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[224e4a08-e512-462d-b63e-bb0e92150a96]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:08 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 Sep 05 04:49:08 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:08 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe" returned: 0 in 0.894s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:08 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_178addee-e09e-40af-8ab3-1f6ddf0e1e95_p50qk1v5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:49:08 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 04:49:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:08 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe 1G Sep 05 04:49:08 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:08 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4" returned: 0 in 0.664s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:09 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4 Sep 05 04:49:09 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:09 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe 1G" returned: 0 in 0.472s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Downloaded image 178addee-e09e-40af-8ab3-1f6ddf0e1e95 ((None, [{'url': 'file:///opt/stack/data/glance/images/178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'metadata': {}}])) to volume 9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe successfully. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 04:49:09 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Temporary image 178addee-e09e-40af-8ab3-1f6ddf0e1e95 for user 9d81a4a4ca064fe2b9088a2dc2da09b9 is deleted. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Marking volume 9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe as bootable. {{(pid=89807) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d911f782-026b-4691-b04a-798d5124f9a4" returned: 0 in 0.346s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Copying metadata from image 178addee-e09e-40af-8ab3-1f6ddf0e1e95 to 9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe. {{(pid=89807) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Creating volume glance metadata for volume 9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe backed by image 178addee-e09e-40af-8ab3-1f6ddf0e1e95 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '47ad22b1e18d157eedb5d39c9aac61b6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89807) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-quobyte-d911f782-026b-4691-b04a-798d5124f9a4" released by "delete_volume" :: held 1.118s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Created reservations ['ddcbc603-5a56-4975-af92-70dc8c25696c', 'a90a9d62-71ba-45ad-bf8d-eadcef1faeba', 'e15df1e3-fac4-49ea-99d8-60ffd62a6ec3', '9a3d713f-b180-4cdd-be30-a62d0e4a08ff'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cff37e-fa0a-4393-a21d-34817c254405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe', 'volume_size': 1, 'image_id': '178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47ad22b1e18d157eedb5d39c9aac61b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23743fc135f14e5b827da377d54d0a08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9fa7a91927102e48afd83a64ded370c30255f3ded5317705c1867af6c54d10665a328a091ba2b61f11c93714ff36c7cbf8eb71d90476d0176b20b0c241b4a17', 'id': '178addee-e09e-40af-8ab3-1f6ddf0e1e95', 'created_at': datetime.datetime(2026, 9, 5, 2, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/178addee-e09e-40af-8ab3-1f6ddf0e1e95/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49d0b6d-d6c8-401c-8c31-4e712f397dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:09 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Volume volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe (9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe): created successfully Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49d0b6d-d6c8-401c-8c31-4e712f397dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Flow 'volume_create_manager' (dea99472-eb08-4651-b227-8e7feb34bd05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:09 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1f84eacf-578c-4b06-9bd6-fcc8562d8cc6 tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Created volume successfully. Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:09 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:49:09 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:10 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.452s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:49:10 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Deleted volume successfully. Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f69df6c8-24c2-4756-9cb3-da744b2fb659 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-d911f782-026b-4691-b04a-798d5124f9a4-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "cinder-1182d0ce-62f3-44aa-bebf-61c35b6666b2-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-1182d0ce-62f3-44aa-bebf-61c35b6666b2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "cinder-quobyte-1182d0ce-62f3-44aa-bebf-61c35b6666b2" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-quobyte-1182d0ce-62f3-44aa-bebf-61c35b6666b2" acquired by "delete_volume" :: waited 0.047s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Acquiring lock "cinder-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e1b54f-5e90-47fb-9035-4edfcd21ccb2]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:10 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:49:10 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Lock "cinder-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Acquiring lock "cinder-quobyte-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Lock "cinder-quobyte-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe" acquired by "delete_volume" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[6689a54d-b40d-4130-80b4-487f17e8ab9c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:11 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2 Sep 05 04:49:11 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:11 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe Sep 05 04:49:11 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:11 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2" returned: 0 in 0.781s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:11 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2 Sep 05 04:49:11 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:11 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 1.133s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:49:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:49:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:49:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:49:12 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1182d0ce-62f3-44aa-bebf-61c35b6666b2" returned: 0 in 0.567s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-quobyte-1182d0ce-62f3-44aa-bebf-61c35b6666b2" released by "delete_volume" :: held 1.468s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:12 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe" returned: 0 in 1.193s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=127,cinder:SELECT=90,cinder:INSERT=25,cinder:DELETE=8 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=109,cinder:UPDATE=103,cinder:INSERT=36,cinder:DELETE=12 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:49:12 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe Sep 05 04:49:12 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Created reservations ['3320dcb7-239d-4c44-92c5-29f77f95470b', 'fadafee5-acf2-49c5-a084-446efd00fbc5', '0232b653-5333-4876-a9f9-7028b6d646ed', 'adb318ef-41f4-4ea5-9a59-133375b55c58'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:12 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:49:12 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:12 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe" returned: 0 in 0.773s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Lock "cinder-quobyte-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe" released by "delete_volume" :: held 2.074s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:13 devstack cinder-volume[89807]: WARNING cinder.quota [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:49:13 devstack cinder-volume[89807]: WARNING cinder.quota [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:49:13 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.663s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:49:13 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Deleted volume successfully. Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Created reservations ['46a47c2d-b204-453d-8fa0-57d3160598bc', 'e95fe8c1-57e9-4891-8190-d842a15638b4', 'f7a1a125-d384-4413-b29d-66958999d9d4', '4b451d7f-fb9e-4c6f-96ea-2b28fac789ab'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0dcfb21e-5304-4726-81a9-c5bfff052257 tempest-CinderUnicodeTest-523574672 None] Lock "cinder-1182d0ce-62f3-44aa-bebf-61c35b6666b2-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:13 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:49:13 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:13 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.436s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:49:13 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Deleted volume successfully. Sep 05 04:49:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-53e378cd-bcfa-4214-a005-36ed54c1a15d tempest-VolumeAndVolumeTypeFromImageTest-814627180 None] Lock "cinder-9f8a1c66-f2aa-470a-92fc-eae0edfe9dfe-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (434ccf93-2253-4e8d-bf06-a23338a476ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06038fa-8ebd-4a26-9d4b-00c5308cf5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06038fa-8ebd-4a26-9d4b-00c5308cf5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644767323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9fc61c-5487-4efb-a2de-0d87eb2b212b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:23Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724bee80-986c-4e67-936c-297a8a3f9970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724bee80-986c-4e67-936c-297a8a3f9970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5afa048-048f-4be7-8f97-c35c55370a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5afa048-048f-4be7-8f97-c35c55370a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d9fc61c-5487-4efb-a2de-0d87eb2b212b', 'volume_name': 'volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a33c649-cf22-4e30-bd9e-021cab188436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a33c649-cf22-4e30-bd9e-021cab188436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d98f33-c021-4b91-be10-eeee250f7eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:22 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume 8d9fc61c-5487-4efb-a2de-0d87eb2b212b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b', 'volume_size': 1} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644767323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9fc61c-5487-4efb-a2de-0d87eb2b212b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:23Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Creating volume 8d9fc61c-5487-4efb-a2de-0d87eb2b212b {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:49:22 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:49:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:23 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b 1073741824 Sep 05 04:49:23 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:23 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b 1073741824" returned: 0 in 0.540s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:23 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b Sep 05 04:49:23 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:23 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b" returned: 0 in 0.341s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:49:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d98f33-c021-4b91-be10-eeee250f7eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3344c285-1e6d-4677-a64f-b4510be607ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:23 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b (8d9fc61c-5487-4efb-a2de-0d87eb2b212b): created successfully Sep 05 04:49:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3344c285-1e6d-4677-a64f-b4510be607ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (434ccf93-2253-4e8d-bf06-a23338a476ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:23 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-af79de64-c9b3-454e-b01c-6a8633625c72 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created volume successfully. Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (8e3c4ab7-0860-4832-9e85-4bc5733a9e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b5594f-3451-4c3f-a0de-320889e342d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b5594f-3451-4c3f-a0de-320889e342d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1473152063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc7ba00-5730-428c-8fe1-b139c2d2442c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:25Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6262c8a3-cdb5-423e-8398-891a5df88b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6262c8a3-cdb5-423e-8398-891a5df88b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efd5d04-a1b8-4a82-a1d4-acf244c26ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efd5d04-a1b8-4a82-a1d4-acf244c26ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc7ba00-5730-428c-8fe1-b139c2d2442c', 'volume_name': 'volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccaf345c-5771-4776-80e2-a3d360147c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccaf345c-5771-4776-80e2-a3d360147c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ab42b4-8d6f-4e12-a083-8dcd27a7a194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:25 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume 8fc7ba00-5730-428c-8fe1-b139c2d2442c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c', 'volume_size': 1} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1473152063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc7ba00-5730-428c-8fe1-b139c2d2442c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:25Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Creating volume 8fc7ba00-5730-428c-8fe1-b139c2d2442c {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:49:25 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:49:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:25 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c 1073741824 Sep 05 04:49:25 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (754ed103-977a-40c5-be15-7b81860f21a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c0a912-ee19-48a7-a39c-c99eb04bb41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c0a912-ee19-48a7-a39c-c99eb04bb41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371382445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac46f3af-ba79-4d59-830f-6e68d826a5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:26Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94daeff-64a3-40b2-b604-261cd4579c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94daeff-64a3-40b2-b604-261cd4579c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa15c23-dfd1-49ac-844c-d800078fb760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa15c23-dfd1-49ac-844c-d800078fb760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac46f3af-ba79-4d59-830f-6e68d826a5de', 'volume_name': 'volume-ac46f3af-ba79-4d59-830f-6e68d826a5de', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a1526b-f080-4399-98ce-644e24e3b353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a1526b-f080-4399-98ce-644e24e3b353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af80d31-5012-41d4-9354-8bffffd23cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:26 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume ac46f3af-ba79-4d59-830f-6e68d826a5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac46f3af-ba79-4d59-830f-6e68d826a5de', 'volume_size': 1} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:26 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c 1073741824" returned: 0 in 0.830s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:26 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c Sep 05 04:49:26 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (a3c44744-986d-45c8-b604-5c636c9d2064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2089a8-5a3c-4855-ba78-204c3dc8fcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2089a8-5a3c-4855-ba78-204c3dc8fcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1340920040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e08d441-73c6-4d2f-ac23-047ebb7ff76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:27Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd27c5db-e864-44de-9d82-2a1b4a3d1ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd27c5db-e864-44de-9d82-2a1b4a3d1ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a86035-9a9c-4ebc-b4d6-00254159dd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a86035-9a9c-4ebc-b4d6-00254159dd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e08d441-73c6-4d2f-ac23-047ebb7ff76c', 'volume_name': 'volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:26 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e855b00a-c4ed-4b67-b07b-333cd39bda50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e855b00a-c4ed-4b67-b07b-333cd39bda50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d356f907-5e08-4998-9623-9329e1fffdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:26 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume 9e08d441-73c6-4d2f-ac23-047ebb7ff76c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c', 'volume_size': 1} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c" returned: 0 in 0.435s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371382445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac46f3af-ba79-4d59-830f-6e68d826a5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:26Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Creating volume ac46f3af-ba79-4d59-830f-6e68d826a5de {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:49:26 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:49:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ab42b4-8d6f-4e12-a083-8dcd27a7a194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3791de09-7951-44b5-99b7-054551ac627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de 1073741824 Sep 05 04:49:27 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:27 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c (8fc7ba00-5730-428c-8fe1-b139c2d2442c): created successfully Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3791de09-7951-44b5-99b7-054551ac627e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (8e3c4ab7-0860-4832-9e85-4bc5733a9e3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:27 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-35394797-243c-474d-ad90-a245686ffd2e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created volume successfully. Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (e35dd572-b57c-4098-a26b-3f5561fcdde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad1c555-31bb-439c-8c79-b9f0f2ac3518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad1c555-31bb-439c-8c79-b9f0f2ac3518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1749154273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad0fd68-f059-4f82-8c7c-8714e0628851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:27Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26aa447d-ae04-4f6a-9584-2710289fde4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26aa447d-ae04-4f6a-9584-2710289fde4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b50b92-f0a6-4031-b1ff-d310be3b4715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b50b92-f0a6-4031-b1ff-d310be3b4715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad0fd68-f059-4f82-8c7c-8714e0628851', 'volume_name': 'volume-3ad0fd68-f059-4f82-8c7c-8714e0628851', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6e156c-cab0-4c3b-8b20-448423bc72a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6e156c-cab0-4c3b-8b20-448423bc72a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608aa95c-b098-4031-a7fc-488ddcdb4450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume 3ad0fd68-f059-4f82-8c7c-8714e0628851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad0fd68-f059-4f82-8c7c-8714e0628851', 'volume_size': 1} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:27 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de 1073741824" returned: 0 in 0.727s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:27 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de Sep 05 04:49:27 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (802cc340-22fc-4227-9a86-342cb0e5fcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1f126c-45e2-4d65-aee8-366881c11ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1f126c-45e2-4d65-aee8-366881c11ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1418391276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:28Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b908119-498e-4d84-b562-11c0d54346f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b908119-498e-4d84-b562-11c0d54346f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80444b57-1b81-4931-a236-7cc5cec108c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80444b57-1b81-4931-a236-7cc5cec108c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37', 'volume_name': 'volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545d9423-cf7a-4152-b2e4-e7b6965a80a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545d9423-cf7a-4152-b2e4-e7b6965a80a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1fab94-7d62-48e6-b33e-bb2c2c22436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:27 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume 85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37', 'volume_size': 1} Sep 05 04:49:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:28 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de" returned: 0 in 0.324s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.146s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1340920040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e08d441-73c6-4d2f-ac23-047ebb7ff76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:27Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Creating volume 9e08d441-73c6-4d2f-ac23-047ebb7ff76c {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:49:28 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af80d31-5012-41d4-9354-8bffffd23cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac46f3af-ba79-4d59-830f-6e68d826a5de', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64652fd0-5807-41c5-9715-a7fc080c3ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:28 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c 1073741824 Sep 05 04:49:28 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:28 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume volume-ac46f3af-ba79-4d59-830f-6e68d826a5de (ac46f3af-ba79-4d59-830f-6e68d826a5de): created successfully Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64652fd0-5807-41c5-9715-a7fc080c3ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (754ed103-977a-40c5-be15-7b81860f21a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:28 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-442a1080-bf19-45d0-ba0e-0d82f7782b4c tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created volume successfully. Sep 05 04:49:28 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c 1073741824" returned: 0 in 0.710s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:28 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c Sep 05 04:49:28 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:29 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c" returned: 0 in 0.508s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.017s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1749154273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad0fd68-f059-4f82-8c7c-8714e0628851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:27Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Creating volume 3ad0fd68-f059-4f82-8c7c-8714e0628851 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:49:29 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:29 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851 1073741824 Sep 05 04:49:29 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d356f907-5e08-4998-9623-9329e1fffdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e84fedb-8f84-4acd-9e6e-fe30d35fbaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c (9e08d441-73c6-4d2f-ac23-047ebb7ff76c): created successfully Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e84fedb-8f84-4acd-9e6e-fe30d35fbaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (a3c44744-986d-45c8-b604-5c636c9d2064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a6a70d8b-b930-4684-aa38-9785af25385e tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created volume successfully. Sep 05 04:49:30 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851 1073741824" returned: 0 in 0.794s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:30 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851 Sep 05 04:49:30 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:30 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851" returned: 0 in 0.299s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.611s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1418391276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4802f298845b5b611e470e498b676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:28Z,use_quota=True,user_id='433ed9d4ca3f4d32afefac46f5e1b69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Creating volume 85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:49:30 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608aa95c-b098-4031-a7fc-488ddcdb4450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad0fd68-f059-4f82-8c7c-8714e0628851', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:30 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 1073741824 Sep 05 04:49:30 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414acd43-bd7e-4315-b711-8717d984a9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume volume-3ad0fd68-f059-4f82-8c7c-8714e0628851 (3ad0fd68-f059-4f82-8c7c-8714e0628851): created successfully Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414acd43-bd7e-4315-b711-8717d984a9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (e35dd572-b57c-4098-a26b-3f5561fcdde5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f02faf88-b752-4e33-a9e4-606d2569e52f tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created volume successfully. Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Flow 'volume_create_manager' (b13f91b2-4db2-4b59-80a6-bb2643f0b894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ee28ad-1d38-46a3-9b50-92f8c6edb65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ee28ad-1d38-46a3-9b50-92f8c6edb65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-86475177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4df27e3-34ec-4aa9-889c-3749d9f5f89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15400ee707f34252b2d9eedef67b93b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:31Z,use_quota=True,user_id='1741a417b8594dfcb9bb3d961945dd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ed379d-fb16-42d1-8132-c090f49fe765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ed379d-fb16-42d1-8132-c090f49fe765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a35977e-d8dc-4538-9b71-563ad9477530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:31 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a35977e-d8dc-4538-9b71-563ad9477530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4df27e3-34ec-4aa9-889c-3749d9f5f89f', 'volume_name': 'volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3266577e-ce48-4ade-81fc-18461658a110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3266577e-ce48-4ade-81fc-18461658a110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a260798-ec7a-4085-ac71-b33bda3dfb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:31 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Volume e4df27e3-34ec-4aa9-889c-3749d9f5f89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f', 'volume_size': 1} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 1073741824" returned: 0 in 0.552s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:31 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 Sep 05 04:49:31 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:31 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37" returned: 0 in 0.268s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.309s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-86475177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4df27e3-34ec-4aa9-889c-3749d9f5f89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15400ee707f34252b2d9eedef67b93b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:31Z,use_quota=True,user_id='1741a417b8594dfcb9bb3d961945dd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Creating volume e4df27e3-34ec-4aa9-889c-3749d9f5f89f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:49:31 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1fab94-7d62-48e6-b33e-bb2c2c22436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:31 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f 1073741824 Sep 05 04:49:31 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3881d7e-96fe-4713-a2ba-dec35c1bb707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:31 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Volume volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 (85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37): created successfully Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3881d7e-96fe-4713-a2ba-dec35c1bb707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Flow 'volume_create_manager' (802cc340-22fc-4227-9a86-342cb0e5fcf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:31 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a1f82e64-8c53-4cae-8765-acac4039efb7 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created volume successfully. Sep 05 04:49:31 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f 1073741824" returned: 0 in 0.470s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:32 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f Sep 05 04:49:32 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:32 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f" returned: 0 in 0.294s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a260798-ec7a-4085-ac71-b33bda3dfb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2841bf-d343-4911-8a0f-bd857599700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:32 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Volume volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f (e4df27e3-34ec-4aa9-889c-3749d9f5f89f): created successfully Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2841bf-d343-4911-8a0f-bd857599700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Flow 'volume_create_manager' (b13f91b2-4db2-4b59-80a6-bb2643f0b894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3c12a5ef-b7e5-47a7-9731-1f4438d23da3 tempest-TestImageHashVerification-54156320 None] Created volume successfully. Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-quobyte-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[599bb6ca-2a9a-417d-97cb-4c8b48eb4841]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:32 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 Sep 05 04:49:32 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:32 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37" returned: 0 in 0.395s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:32 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37 Sep 05 04:49:32 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:33 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37" returned: 0 in 0.295s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37" released by "delete_volume" :: held 0.741s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created reservations ['c21badee-9642-4c2d-9965-ca9dcd8c6e94', 'e54438d1-9967-479f-9be1-2db930e760f6', '0baa6ec3-c061-4013-9b38-8561d8036f38', 'ab5a5b55-95cc-4acb-b137-68dadc1d3ce1'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:33 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:49:33 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-3ad0fd68-f059-4f82-8c7c-8714e0628851-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:33 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-3ad0fd68-f059-4f82-8c7c-8714e0628851-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.334s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:49:33 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Deleted volume successfully. Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-quobyte-3ad0fd68-f059-4f82-8c7c-8714e0628851" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a1b6423f-b827-4df5-86e2-b86e42437e57 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-85b0bfb4-0fbf-426f-bd1c-f88fd3e72e37-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-3ad0fd68-f059-4f82-8c7c-8714e0628851" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[30db2a6a-1dbc-4d99-afd2-6682cbe6f9c2]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:33 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851 Sep 05 04:49:33 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdc8547-0f70-4743-820d-031074520541]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:34 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851" returned: 0 in 0.474s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:34 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851 Sep 05 04:49:34 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:34 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f Sep 05 04:49:34 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:34 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ad0fd68-f059-4f82-8c7c-8714e0628851" returned: 0 in 0.401s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-3ad0fd68-f059-4f82-8c7c-8714e0628851" released by "delete_volume" :: held 0.930s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created reservations ['fad45764-838d-4472-af33-6c294dc83f4c', 'cd6210e2-86b2-4e86-98d6-80fc93a91d5d', '3b912446-0d97-48b3-b7b9-422ef315562e', 'd7c69f69-543d-4658-926d-ed210754abe4'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:49:34 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f" returned: 0 in 0.741s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc07fc8-45b6-4c67-aa7a-68f322e82f05]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:35 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:49:35 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:35 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f Sep 05 04:49:35 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:35 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.360s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:49:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Deleted volume successfully. Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-343344ca-0614-48a8-a22e-6b976e6ab0e6 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-3ad0fd68-f059-4f82-8c7c-8714e0628851-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:35 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f" returned: 0 in 0.560s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f /opt/stack/data/cinder/conversion/e4df27e3-34ec-4aa9-889c-3749d9f5f89f.temp_image.079599ed-2640-434e-9f19-2c4575afeb65rlv08weh.img {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:35 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f /opt/stack/data/cinder/conversion/e4df27e3-34ec-4aa9-889c-3749d9f5f89f.temp_image.079599ed-2640-434e-9f19-2c4575afeb65rlv08weh.img Sep 05 04:49:35 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-9e08d441-73c6-4d2f-ac23-047ebb7ff76c-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-9e08d441-73c6-4d2f-ac23-047ebb7ff76c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-quobyte-9e08d441-73c6-4d2f-ac23-047ebb7ff76c" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-9e08d441-73c6-4d2f-ac23-047ebb7ff76c" acquired by "delete_volume" :: waited 0.053s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:36 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c859dc-5238-4650-9de3-0b40819a2506]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:36 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c Sep 05 04:49:36 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:37 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c" returned: 0 in 1.307s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:37 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c Sep 05 04:49:37 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:38 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9e08d441-73c6-4d2f-ac23-047ebb7ff76c" returned: 0 in 0.770s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-9e08d441-73c6-4d2f-ac23-047ebb7ff76c" released by "delete_volume" :: held 2.212s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:38 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created reservations ['ea6c6dbb-da60-4b96-96b8-b61d44b9374d', '99807da4-6331-4f9e-a3b4-bfa86d7a04e2', '519d6689-4a5e-48e2-b2b1-b4ba98e7d280', '5d68166f-272c-46da-a292-1bb7df2ab8b7'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:49:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:38 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:49:38 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:39 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.494s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:39 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:49:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Deleted volume successfully. Sep 05 04:49:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9d4a8200-3e0b-4146-8d06-c9fe6fbd9358 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-9e08d441-73c6-4d2f-ac23-047ebb7ff76c-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-ac46f3af-ba79-4d59-830f-6e68d826a5de-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-ac46f3af-ba79-4d59-830f-6e68d826a5de-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-quobyte-ac46f3af-ba79-4d59-830f-6e68d826a5de" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-ac46f3af-ba79-4d59-830f-6e68d826a5de" acquired by "delete_volume" :: waited 0.053s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:40 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e551e2cc-774d-431a-af81-e02f23ae0a32]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:40 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de Sep 05 04:49:40 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:41 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de" returned: 0 in 0.987s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:41 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de Sep 05 04:49:41 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:41 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f /opt/stack/data/cinder/conversion/e4df27e3-34ec-4aa9-889c-3749d9f5f89f.temp_image.079599ed-2640-434e-9f19-2c4575afeb65rlv08weh.img" returned: 0 in 6.076s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:41 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21c2131-6f76-4bb8-b813-f89b98256475]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:41 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac46f3af-ba79-4d59-830f-6e68d826a5de" returned: 0 in 0.485s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-ac46f3af-ba79-4d59-830f-6e68d826a5de" released by "delete_volume" :: held 1.578s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:41 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f Sep 05 04:49:41 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:41 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created reservations ['3ce4493b-cf80-4d6d-9bb6-33f17611ffaf', '5bd47dc5-23cc-4d7c-9603-65dd77e8b1c0', '6193f6a4-0389-458c-89c6-dd370fd42737', 'd11f5955-e419-430d-a3cb-9a20a889d87e'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:42 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:49:42 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:42 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.400s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:49:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Deleted volume successfully. Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-97c1b872-9a55-4e6f-9e93-7e80e84ba52b tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-ac46f3af-ba79-4d59-830f-6e68d826a5de-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-8fc7ba00-5730-428c-8fe1-b139c2d2442c-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-8fc7ba00-5730-428c-8fe1-b139c2d2442c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:42 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f" returned: 0 in 0.950s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/conversion/e4df27e3-34ec-4aa9-889c-3749d9f5f89f.temp_image.079599ed-2640-434e-9f19-2c4575afeb65rlv08weh.img {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:49:42 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Converted 1024.00 MB image at 168.42 MB/s Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] 079599ed-2640-434e-9f19-2c4575afeb65 was raw, no need to convert to raw {{(pid=89807) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-quobyte-8fc7ba00-5730-428c-8fe1-b139c2d2442c" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-8fc7ba00-5730-428c-8fe1-b139c2d2442c" acquired by "delete_volume" :: waited 0.027s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[61386688-1e9e-4617-ad2f-b37836ad95be]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:42 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c Sep 05 04:49:42 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-93539249-16a8-4fd7-9a91-560bb1dc9af8 req-f1cf504a-acbb-4b3a-94b5-b74fa4c8160e tempest-AttachVolumeNegativeTest-340087041 None] Terminate volume connection completed successfully. Sep 05 04:49:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-93539249-16a8-4fd7-9a91-560bb1dc9af8 req-f1cf504a-acbb-4b3a-94b5-b74fa4c8160e tempest-AttachVolumeNegativeTest-340087041 None] Deleting attachment 15e4ac70-dca0-41e5-8879-cb52c8b15b60. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:49:43 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c" returned: 0 in 0.524s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:43 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c Sep 05 04:49:43 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:43 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8fc7ba00-5730-428c-8fe1-b139c2d2442c" returned: 0 in 0.308s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-8fc7ba00-5730-428c-8fe1-b139c2d2442c" released by "delete_volume" :: held 0.903s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created reservations ['6c20ced3-59c8-4898-bc3e-665e8e24ee58', 'd323d2b0-0f67-41a4-83f3-ee2c6da00353', '8dec5019-7fce-4f91-a7a4-0e6d445d13c1', '21fffbb0-f7c0-4739-9491-c3f985c427c5'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:43 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:49:43 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:44 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.351s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:44 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:49:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Deleted volume successfully. Sep 05 04:49:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f27c0871-2486-40cf-af4b-72c1aae90896 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-8fc7ba00-5730-428c-8fe1-b139c2d2442c-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-8d9fc61c-5487-4efb-a2de-0d87eb2b212b-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-8d9fc61c-5487-4efb-a2de-0d87eb2b212b-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "cinder-quobyte-8d9fc61c-5487-4efb-a2de-0d87eb2b212b" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:49:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-8d9fc61c-5487-4efb-a2de-0d87eb2b212b" acquired by "delete_volume" :: waited 0.047s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:49:45 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bccdd0f-7a1a-4b49-93eb-ec43a235ffcd]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:45 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b Sep 05 04:49:45 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:45 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b" returned: 0 in 0.637s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:45 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b Sep 05 04:49:45 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:46 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8d9fc61c-5487-4efb-a2de-0d87eb2b212b" returned: 0 in 0.480s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-quobyte-8d9fc61c-5487-4efb-a2de-0d87eb2b212b" released by "delete_volume" :: held 1.205s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Created reservations ['b70c398a-1e12-433d-a3a8-37a56bc7d564', '3e5ad5a5-844a-4455-bc8a-a1e7fd28cf99', '080ded74-d5bb-400b-bdbc-d98f507bb29e', 'b9f80548-9dd5-4c51-ad86-32152b91792d'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:46 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:49:46 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:46 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.318s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:49:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Deleted volume successfully. Sep 05 04:49:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7fb34db8-4d6c-43cb-98b3-e31350e02898 tempest-CreateVolumesFromSourceVolumeTest-1121944566 None] Lock "cinder-8d9fc61c-5487-4efb-a2de-0d87eb2b212b-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Flow 'volume_create_manager' (f0e38636-9df5-486c-b6ab-7558f614998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56559b31-a116-4bd5-8711-e70f8e2a9f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56559b31-a116-4bd5-8711-e70f8e2a9f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec15ffb-acc6-443c-bc40-8e12a3a224c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf109df3e35495bb5b7a4564e3fc5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:56Z,use_quota=True,user_id='8e2556fc999e437fa99be454cf4ed7ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c377eb8d-83db-47d4-bc89-7ef087496b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c377eb8d-83db-47d4-bc89-7ef087496b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fada0b-5115-4d78-ac41-6474f9c71603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.image.glance [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Creating Keystone auth plugin from conf {{(pid=89807) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fada0b-5115-4d78-ac41-6474f9c71603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ec15ffb-acc6-443c-bc40-8e12a3a224c7', 'volume_name': 'volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7', 'volume_size': 1, 'image_id': '596578a8-8d19-4b4b-80ae-791a327e3182', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/596578a8-8d19-4b4b-80ae-791a327e3182', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19d934c653c0095c6e1cdd9d25927c10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3cf109df3e35495bb5b7a4564e3fc5b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb36a789b7d7a0cf3f357dceefd9445783cdbcc4e85be21a66f5fead53f344f6eecb6f3273dc12d79cca498f7bd55b740a5882eb930ba59cd995faf6cc892eea', 'id': '596578a8-8d19-4b4b-80ae-791a327e3182', 'created_at': datetime.datetime(2026, 9, 5, 2, 49, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 49, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/596578a8-8d19-4b4b-80ae-791a327e3182/file', 'properties': {}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a11b9ebf-0ced-40db-aa7a-bf0f3832acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a11b9ebf-0ced-40db-aa7a-bf0f3832acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934156b9-4de8-4387-8830-9fa6724582d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:49:56 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Volume 1ec15ffb-acc6-443c-bc40-8e12a3a224c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7', 'volume_size': 1, 'image_id': '596578a8-8d19-4b4b-80ae-791a327e3182', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/596578a8-8d19-4b4b-80ae-791a327e3182', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19d934c653c0095c6e1cdd9d25927c10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3cf109df3e35495bb5b7a4564e3fc5b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb36a789b7d7a0cf3f357dceefd9445783cdbcc4e85be21a66f5fead53f344f6eecb6f3273dc12d79cca498f7bd55b740a5882eb930ba59cd995faf6cc892eea', 'id': '596578a8-8d19-4b4b-80ae-791a327e3182', 'created_at': datetime.datetime(2026, 9, 5, 2, 49, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 49, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/596578a8-8d19-4b4b-80ae-791a327e3182/file', 'properties': {}}, 'image_service': } Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Trying to clone 1ec15ffb-acc6-443c-bc40-8e12a3a224c7 from image 596578a8-8d19-4b4b-80ae-791a327e3182 at location (None, [{'url': 'file:///opt/stack/data/glance/images/596578a8-8d19-4b4b-80ae-791a327e3182', 'metadata': {}}]). {{(pid=89807) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 04:49:56 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Image download 0.00 MB at 0.00 MB/s Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[111384d4-b5ae-41b3-bd51-2fe6f5f8baa4]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:57 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD Sep 05 04:49:57 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:57 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:57 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD Sep 05 04:49:57 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:57 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD" returned: 1 in 0.538s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:49:57 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Temporary image 596578a8-8d19-4b4b-80ae-791a327e3182 is fetched for user 8e2556fc999e437fa99be454cf4ed7ac. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 04:49:58 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[83109cbb-ef4f-4507-bf64-86564ef79e6a]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:49:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:58 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD Sep 05 04:49:58 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:58 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD" returned: 0 in 0.582s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:49:58 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD Sep 05 04:49:58 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:49:59 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 05 04:49:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD" returned: 1 in 0.538s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:49:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:49:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:08 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=89,cinder:SELECT=55,cinder:INSERT=15,cinder:DELETE=7 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:50:08 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=54,cinder:INSERT=25,cinder:UPDATE=80,cinder:DELETE=8 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:50:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:50:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:10 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:10 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:10 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Flow 'volume_create_manager' (d29e9416-3f75-452e-b937-30f0f9e379c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f167075e-87a1-4b1d-b7ae-1827ac442fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f167075e-87a1-4b1d-b7ae-1827ac442fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1538801489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c09f23d-80db-4924-945e-2e8ab7d4793f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec973f7a54724ba7a367d44ec8a80707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:11Z,use_quota=True,user_id='5627c1f0b1b244a894cd70b2c0056c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7697bb8-565c-456a-94a0-01f3713bd338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7697bb8-565c-456a-94a0-01f3713bd338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fff592-b159-4a23-adaf-29fb17ba9aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fff592-b159-4a23-adaf-29fb17ba9aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c09f23d-80db-4924-945e-2e8ab7d4793f', 'volume_name': 'volume-6c09f23d-80db-4924-945e-2e8ab7d4793f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c670161-3382-4426-a399-f3e1f93ec933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c670161-3382-4426-a399-f3e1f93ec933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69c01d8-c880-488d-b7a1-417e0d62a98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:11 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Volume 6c09f23d-80db-4924-945e-2e8ab7d4793f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c09f23d-80db-4924-945e-2e8ab7d4793f', 'volume_size': 1} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:11 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.540s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:50:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.435s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Uploaded volume to glance image-id: 079599ed-2640-434e-9f19-2c4575afeb65. {{(pid=89807) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.374s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec15ffb-acc6-443c-bc40-8e12a3a224c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf109df3e35495bb5b7a4564e3fc5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:49:56Z,use_quota=True,user_id='8e2556fc999e437fa99be454cf4ed7ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Creating volume 1ec15ffb-acc6-443c-bc40-8e12a3a224c7 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:50:13 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:50:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:13 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 1073741824 Sep 05 04:50:13 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:13 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b8040aa6-8621-4a7a-8e2e-3e64c3b6fe95 tempest-TestImageHashVerification-54156320 None] Copy volume to image completed successfully. Sep 05 04:50:14 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 1073741824" returned: 0 in 0.419s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:14 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 Sep 05 04:50:14 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:14 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.163s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1538801489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c09f23d-80db-4924-945e-2e8ab7d4793f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec973f7a54724ba7a367d44ec8a80707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:11Z,use_quota=True,user_id='5627c1f0b1b244a894cd70b2c0056c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Creating volume 6c09f23d-80db-4924-945e-2e8ab7d4793f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:50:14 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:14 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f 1073741824 Sep 05 04:50:14 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Attempting download of 596578a8-8d19-4b4b-80ae-791a327e3182 ((None, [{'url': 'file:///opt/stack/data/glance/images/596578a8-8d19-4b4b-80ae-791a327e3182', 'metadata': {}}])) to volume 1ec15ffb-acc6-443c-bc40-8e12a3a224c7. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab83ae6-9a60-4e9f-993e-117cd3194c15]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_596578a8-8d19-4b4b-80ae-791a327e3182_v0t_qn0b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:14 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_596578a8-8d19-4b4b-80ae-791a327e3182_v0t_qn0b Sep 05 04:50:14 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:14 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f 1073741824" returned: 0 in 0.470s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:14 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_596578a8-8d19-4b4b-80ae-791a327e3182_v0t_qn0b" returned: 0 in 0.440s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_596578a8-8d19-4b4b-80ae-791a327e3182_v0t_qn0b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:14 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f Sep 05 04:50:14 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:15 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_596578a8-8d19-4b4b-80ae-791a327e3182_v0t_qn0b Sep 05 04:50:15 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:15 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f" returned: 0 in 0.283s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69c01d8-c880-488d-b7a1-417e0d62a98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c09f23d-80db-4924-945e-2e8ab7d4793f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060f6411-a468-4912-b933-17ff568554be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:15 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Volume volume-6c09f23d-80db-4924-945e-2e8ab7d4793f (6c09f23d-80db-4924-945e-2e8ab7d4793f): created successfully Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060f6411-a468-4912-b933-17ff568554be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Flow 'volume_create_manager' (d29e9416-3f75-452e-b937-30f0f9e379c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:15 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d282f1e7-c80c-43f5-b7fc-4d2767307368 tempest-SnapshotDependencyTests-326645547 None] Created volume successfully. Sep 05 04:50:15 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_596578a8-8d19-4b4b-80ae-791a327e3182_v0t_qn0b" returned: 1 in 0.407s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_596578a8-8d19-4b4b-80ae-791a327e3182_v0t_qn0b' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[36446ea7-1900-4f2d-a7e4-c37d535cbc76]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:15 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD Sep 05 04:50:15 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Acquiring lock "cinder-e4df27e3-34ec-4aa9-889c-3749d9f5f89f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Lock "cinder-e4df27e3-34ec-4aa9-889c-3749d9f5f89f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Acquiring lock "cinder-quobyte-e4df27e3-34ec-4aa9-889c-3749d9f5f89f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Lock "cinder-quobyte-e4df27e3-34ec-4aa9-889c-3749d9f5f89f" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe7ce1a-70f1-4883-b66c-1dd7ba0d3e1a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:15 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f Sep 05 04:50:15 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:15 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:15 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD Sep 05 04:50:15 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:16 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f" returned: 0 in 0.394s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:16 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f Sep 05 04:50:16 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:16 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] 596578a8-8d19-4b4b-80ae-791a327e3182 was raw, converting to qcow2 {{(pid=89807) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:16 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 Sep 05 04:50:16 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:16 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e4df27e3-34ec-4aa9-889c-3749d9f5f89f" returned: 0 in 0.305s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Lock "cinder-quobyte-e4df27e3-34ec-4aa9-889c-3749d9f5f89f" released by "delete_volume" :: held 0.770s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Created reservations ['6928be53-2791-4fc8-a160-f9fbf0119feb', '3a39d733-127a-47a6-84bc-cfa55daace6c', '1ed02b7c-bdac-405d-8658-faf3b1cfe221', '0f85f00f-e223-488a-b0fd-01eedcbc66f5'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Creating offline snapshot 5d33e708-8423-4e90-8962-d168ad3e14ce of volume 6c09f23d-80db-4924-945e-2e8ab7d4793f {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a60470-e5ac-48d5-bc47-d928e3cd16d4]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:16 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:16 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:16 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f Sep 05 04:50:16 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:16 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7" returned: 0 in 0.564s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_596578a8-8d19-4b4b-80ae-791a327e3182_n6docvlodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:50:16 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:16 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 1G Sep 05 04:50:16 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:16 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.287s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:16 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Deleted volume successfully. Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1c60a337-5d51-4792-8127-efc084147ada tempest-TestImageHashVerification-54156320 None] Lock "cinder-e4df27e3-34ec-4aa9-889c-3749d9f5f89f-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:16 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f" returned: 0 in 0.453s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:16 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce 1G Sep 05 04:50:16 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:17 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 1G" returned: 0 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Downloaded image 596578a8-8d19-4b4b-80ae-791a327e3182 ((None, [{'url': 'file:///opt/stack/data/glance/images/596578a8-8d19-4b4b-80ae-791a327e3182', 'metadata': {}}])) to volume 1ec15ffb-acc6-443c-bc40-8e12a3a224c7 successfully. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Temporary image 596578a8-8d19-4b4b-80ae-791a327e3182 for user 8e2556fc999e437fa99be454cf4ed7ac is deleted. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Marking volume 1ec15ffb-acc6-443c-bc40-8e12a3a224c7 as bootable. {{(pid=89807) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Copying metadata from image 596578a8-8d19-4b4b-80ae-791a327e3182 to 1ec15ffb-acc6-443c-bc40-8e12a3a224c7. {{(pid=89807) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Creating volume glance metadata for volume 1ec15ffb-acc6-443c-bc40-8e12a3a224c7 backed by image 596578a8-8d19-4b4b-80ae-791a327e3182 with: {'image_id': '596578a8-8d19-4b4b-80ae-791a327e3182', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '19d934c653c0095c6e1cdd9d25927c10', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89807) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934156b9-4de8-4387-8830-9fa6724582d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7', 'volume_size': 1, 'image_id': '596578a8-8d19-4b4b-80ae-791a327e3182', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/596578a8-8d19-4b4b-80ae-791a327e3182', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19d934c653c0095c6e1cdd9d25927c10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3cf109df3e35495bb5b7a4564e3fc5b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb36a789b7d7a0cf3f357dceefd9445783cdbcc4e85be21a66f5fead53f344f6eecb6f3273dc12d79cca498f7bd55b740a5882eb930ba59cd995faf6cc892eea', 'id': '596578a8-8d19-4b4b-80ae-791a327e3182', 'created_at': datetime.datetime(2026, 9, 5, 2, 49, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 49, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/596578a8-8d19-4b4b-80ae-791a327e3182/file', 'properties': {}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad212d15-5ab4-4236-b7c2-c44cd0221c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:17 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Volume volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 (1ec15ffb-acc6-443c-bc40-8e12a3a224c7): created successfully Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad212d15-5ab4-4236-b7c2-c44cd0221c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Flow 'volume_create_manager' (f0e38636-9df5-486c-b6ab-7558f614998d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-08c1535b-7669-4f73-b041-275a55830820 tempest-VolumeImageDependencyTests-2029133962 None] Created volume successfully. Sep 05 04:50:17 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce 1G" returned: 0 in 0.441s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c09f23d-80db-4924-945e-2e8ab7d4793f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:17 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c09f23d-80db-4924-945e-2e8ab7d4793f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce Sep 05 04:50:17 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:17 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c09f23d-80db-4924-945e-2e8ab7d4793f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce" returned: 0 in 0.364s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:17 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce is being set with open permissions: ugo+rw Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:17 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce Sep 05 04:50:17 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:17 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce" returned: 0 in 0.243s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:18 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.info Sep 05 04:50:18 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Acquiring lock "cinder-1ec15ffb-acc6-443c-bc40-8e12a3a224c7-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:18 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.info" returned: 0 in 0.305s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:18 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.info is being set with open permissions: ugo+rw Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Lock "cinder-1ec15ffb-acc6-443c-bc40-8e12a3a224c7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:18 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.info Sep 05 04:50:18 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Acquiring lock "cinder-quobyte-1ec15ffb-acc6-443c-bc40-8e12a3a224c7" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Lock "cinder-quobyte-1ec15ffb-acc6-443c-bc40-8e12a3a224c7" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fd0747-94e4-4745-9051-ecf6b7f1fadf]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:18 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 Sep 05 04:50:18 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:18 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.info" returned: 0 in 0.285s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:18 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9157aee2-9f3d-494f-8121-1b37410a940e tempest-SnapshotDependencyTests-326645547 None] Create snapshot completed successfully Sep 05 04:50:18 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7" returned: 0 in 0.443s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:18 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7 Sep 05 04:50:18 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:19 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1ec15ffb-acc6-443c-bc40-8e12a3a224c7" returned: 0 in 0.288s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Lock "cinder-quobyte-1ec15ffb-acc6-443c-bc40-8e12a3a224c7" released by "delete_volume" :: held 0.786s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Created reservations ['998ac1ce-fb5e-4abf-b94b-336470c503b9', '00b268ad-720e-44b1-b2e7-7674f1f98f93', '69454f83-e55e-4fbb-8468-6ee779f85bdc', '244615b3-9e46-4ab7-a5f1-15806c477120'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:19 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:19 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:19 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.346s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:19 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Deleted volume successfully. Sep 05 04:50:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb657516-e9ac-467d-bb74-bbae2dd74320 tempest-VolumeImageDependencyTests-2029133962 None] Lock "cinder-1ec15ffb-acc6-443c-bc40-8e12a3a224c7-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Flow 'volume_create_manager' (eca179b7-9c89-4410-9523-6e717ad31547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549729e8-b85f-4acd-8274-06b2e30dfd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549729e8-b85f-4acd-8274-06b2e30dfd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1342e6b2-da8d-4c75-9a02-116606051d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec973f7a54724ba7a367d44ec8a80707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5d33e708-8423-4e90-8962-d168ad3e14ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:20Z,use_quota=True,user_id='5627c1f0b1b244a894cd70b2c0056c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a32197-d42d-4442-8630-fb7fbdd58b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a32197-d42d-4442-8630-fb7fbdd58b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71509c9-a47f-4e99-bfdc-5b7aab018c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71509c9-a47f-4e99-bfdc-5b7aab018c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1342e6b2-da8d-4c75-9a02-116606051d05', 'volume_name': 'volume-1342e6b2-da8d-4c75-9a02-116606051d05', 'volume_size': 1, 'snapshot_id': '5d33e708-8423-4e90-8962-d168ad3e14ce'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b39999-d025-4604-ad95-00e6d79c92e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b39999-d025-4604-ad95-00e6d79c92e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f89a37-f8f5-4ca1-9960-a898b040df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:20 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Volume 1342e6b2-da8d-4c75-9a02-116606051d05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1342e6b2-da8d-4c75-9a02-116606051d05', 'volume_size': 1, 'snapshot_id': '5d33e708-8423-4e90-8962-d168ad3e14ce'} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "cinder-quobyte-5d33e708-8423-4e90-8962-d168ad3e14ce-1342e6b2-da8d-4c75-9a02-116606051d05" by "_create_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-5d33e708-8423-4e90-8962-d168ad3e14ce-1342e6b2-da8d-4c75-9a02-116606051d05" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Creating volume 1342e6b2-da8d-4c75-9a02-116606051d05 from snapshot 5d33e708-8423-4e90-8962-d168ad3e14ce {{(pid=89807) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "cinder-quobyte-1342e6b2-da8d-4c75-9a02-116606051d05" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-1342e6b2-da8d-4c75-9a02-116606051d05" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] snapshot: 5d33e708-8423-4e90-8962-d168ad3e14ce, volume: 1342e6b2-da8d-4c75-9a02-116606051d05, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8807fe69-fca1-4772-b6ad-4b57e034bcda]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:20 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce Sep 05 04:50:20 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:21 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce" returned: 0 in 0.474s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c09f23d-80db-4924-945e-2e8ab7d4793f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:50:21 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5b4414-79ba-4e94-8bad-f69b12f18e6e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:21 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f Sep 05 04:50:21 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:21 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f" returned: 0 in 0.423s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:50:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:50:21 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:50:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:21 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 Sep 05 04:50:21 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:27 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05" returned: 0 in 6.514s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:27 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:50:27 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Converted 1024.00 MB image at 157.17 MB/s Sep 05 04:50:27 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 is being set with open permissions: ugo+rw Sep 05 04:50:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:28 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 Sep 05 04:50:28 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:50:28 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Flow 'volume_create_manager' (d60a365c-0327-4899-9bca-4e9e836b2dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da30ca3-9810-4e9d-ac75-c8814263bc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da30ca3-9810-4e9d-ac75-c8814263bc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-696144974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ed3a58-f6ef-41bc-bb6e-ef354b1beea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8f15735d6849599f6d4cb1b7d52500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:28Z,use_quota=True,user_id='886e0cc81aff46cea32d725d8daf0a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a037d23-20fe-4f04-83d3-b7230364c88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a037d23-20fe-4f04-83d3-b7230364c88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f95bff-4551-432b-b440-04194fde8076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f95bff-4551-432b-b440-04194fde8076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ed3a58-f6ef-41bc-bb6e-ef354b1beea3', 'volume_name': 'volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36951e1-acf7-4703-b210-18ff857bd2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36951e1-acf7-4703-b210-18ff857bd2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf10bf4-37aa-4cd0-9e37-19c9e66163de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:28 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Volume 54ed3a58-f6ef-41bc-bb6e-ef354b1beea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3', 'volume_size': 1} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-1342e6b2-da8d-4c75-9a02-116606051d05" released by "_copy_volume_from_snapshot" :: held 7.960s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-5d33e708-8423-4e90-8962-d168ad3e14ce-1342e6b2-da8d-4c75-9a02-116606051d05" released by "_create_volume_from_snapshot" :: held 8.041s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.060s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.042s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-696144974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ed3a58-f6ef-41bc-bb6e-ef354b1beea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8f15735d6849599f6d4cb1b7d52500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:28Z,use_quota=True,user_id='886e0cc81aff46cea32d725d8daf0a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Creating volume 54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:50:28 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:28 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 1073741824 Sep 05 04:50:28 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f89a37-f8f5-4ca1-9960-a898b040df3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1342e6b2-da8d-4c75-9a02-116606051d05', 'volume_size': 1, 'snapshot_id': '5d33e708-8423-4e90-8962-d168ad3e14ce'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9442ef2-acbb-4725-9e0c-8f4edb212f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:28 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Volume volume-1342e6b2-da8d-4c75-9a02-116606051d05 (1342e6b2-da8d-4c75-9a02-116606051d05): created successfully Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9442ef2-acbb-4725-9e0c-8f4edb212f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Flow 'volume_create_manager' (eca179b7-9c89-4410-9523-6e717ad31547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:28 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3e603741-e4d5-4f85-ac2a-e1a1139db03a tempest-SnapshotDependencyTests-326645547 None] Created volume successfully. Sep 05 04:50:28 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 1073741824" returned: 0 in 0.455s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:29 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 Sep 05 04:50:29 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:29 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3" returned: 0 in 0.284s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf10bf4-37aa-4cd0-9e37-19c9e66163de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1716ed4-937c-48b3-9d36-e64c5dc3319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Volume volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 (54ed3a58-f6ef-41bc-bb6e-ef354b1beea3): created successfully Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1716ed4-937c-48b3-9d36-e64c5dc3319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Flow 'volume_create_manager' (d60a365c-0327-4899-9bca-4e9e836b2dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a16a8b76-ed03-4ae1-ba9b-0e65c1c62144 tempest-AttachVolumeNegativeTest-340087041 None] Created volume successfully. Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "cinder-5d33e708-8423-4e90-8962-d168ad3e14ce-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-5d33e708-8423-4e90-8962-d168ad3e14ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "cinder-quobyte-6c09f23d-80db-4924-945e-2e8ab7d4793f" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-6c09f23d-80db-4924-945e-2e8ab7d4793f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "cinder-quobyte-5d33e708-8423-4e90-8962-d168ad3e14ce" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-5d33e708-8423-4e90-8962-d168ad3e14ce" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Deleting offline snapshot 5d33e708-8423-4e90-8962-d168ad3e14ce of volume 6c09f23d-80db-4924-945e-2e8ab7d4793f {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] snapshot_file for this snap is: volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3badda9a-7fd7-4ce7-bb36-d984017d9e7c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:29 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce Sep 05 04:50:29 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:30 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce" returned: 0 in 0.447s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c09f23d-80db-4924-945e-2e8ab7d4793f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:50:30 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba810b0-bd5c-485e-b332-e797dbb7706a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:30 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f Sep 05 04:50:30 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:30 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f" returned: 0 in 0.668s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:30 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce Sep 05 04:50:30 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:31 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce" returned: 0 in 0.384s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:31 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce Sep 05 04:50:31 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:31 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f.5d33e708-8423-4e90-8962-d168ad3e14ce" returned: 0 in 0.300s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-5d33e708-8423-4e90-8962-d168ad3e14ce" released by "_delete_snapshot" :: held 1.937s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-6c09f23d-80db-4924-945e-2e8ab7d4793f" released by "delete_snapshot" :: held 1.971s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-b513e4bb-8e97-4d2b-aa3e-37aed3d8e5b1 req-100ee678-8525-4067-8e20-6133bd068d3e tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-b513e4bb-8e97-4d2b-aa3e-37aed3d8e5b1 req-100ee678-8525-4067-8e20-6133bd068d3e tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-b513e4bb-8e97-4d2b-aa3e-37aed3d8e5b1 req-100ee678-8525-4067-8e20-6133bd068d3e tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Created reservations ['b7f449f9-41ac-461c-99bc-5b9d6df1497d', 'a8af937d-b4c0-4ddd-86b3-97c4b423cc1c', 'da6e555c-39e9-4a86-ab35-a6ba221250d7', 'c3f8f603-cc3d-49e4-8353-10b0f836cc18'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-b513e4bb-8e97-4d2b-aa3e-37aed3d8e5b1 req-100ee678-8525-4067-8e20-6133bd068d3e tempest-AttachVolumeNegativeTest-340087041 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f5d827f-9e2f-4ba9-810c-a2541f5c8f9b', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:50:31 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Delete snapshot completed successfully. Sep 05 04:50:31 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-b513e4bb-8e97-4d2b-aa3e-37aed3d8e5b1 req-100ee678-8525-4067-8e20-6133bd068d3e tempest-AttachVolumeNegativeTest-340087041 None] attachment_update completed successfully. Sep 05 04:50:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fb81a8be-6d09-4b9e-a4ae-8e3fa1d51275 tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-5d33e708-8423-4e90-8962-d168ad3e14ce-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "cinder-6c09f23d-80db-4924-945e-2e8ab7d4793f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-6c09f23d-80db-4924-945e-2e8ab7d4793f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "cinder-quobyte-6c09f23d-80db-4924-945e-2e8ab7d4793f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-6c09f23d-80db-4924-945e-2e8ab7d4793f" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:32 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e680e5-539f-4ec1-8222-a7876f6814d6]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:32 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f Sep 05 04:50:32 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:33 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f" returned: 0 in 0.364s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:33 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f Sep 05 04:50:33 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:33 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c09f23d-80db-4924-945e-2e8ab7d4793f" returned: 0 in 0.263s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-6c09f23d-80db-4924-945e-2e8ab7d4793f" released by "delete_volume" :: held 0.693s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Created reservations ['3016e9c3-bb30-45ca-8db7-365231b3f971', 'c1bc99a3-f9d3-4b5e-9689-7aa02ff72f69', 'f0b3f4a1-6959-4211-9785-ef78dbae9726', '61db0df6-4e02-4fa0-b871-44a66f90ebe8'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:33 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:33 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:33 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "cinder-1342e6b2-da8d-4c75-9a02-116606051d05-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.280s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:33 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Deleted volume successfully. Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-1342e6b2-da8d-4c75-9a02-116606051d05-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1362164b-18ad-4e0c-aff5-2ec928facdda tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-6c09f23d-80db-4924-945e-2e8ab7d4793f-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "cinder-quobyte-1342e6b2-da8d-4c75-9a02-116606051d05" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-1342e6b2-da8d-4c75-9a02-116606051d05" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[391d23d0-fd5d-4076-928e-9c9f0229e39d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:34 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 Sep 05 04:50:34 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (811f8bde-9bf2-4ab2-a4fa-46821d45b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66d763b-9b95-44a8-9db0-d47ba5589a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66d763b-9b95-44a8-9db0-d47ba5589a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721974802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc6263e-654b-4350-bd4f-8aa5a86024de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:34Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f922f67c-c80b-483e-b57e-a397fb918c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f922f67c-c80b-483e-b57e-a397fb918c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75f4066-7c20-43e4-b6ed-228b81f5585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75f4066-7c20-43e4-b6ed-228b81f5585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcc6263e-654b-4350-bd4f-8aa5a86024de', 'volume_name': 'volume-dcc6263e-654b-4350-bd4f-8aa5a86024de', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd0b158-cb24-4805-9141-5279ea3f6cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd0b158-cb24-4805-9141-5279ea3f6cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45adda0c-4d4d-4ac5-a46a-07c04c6e281a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:34 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume dcc6263e-654b-4350-bd4f-8aa5a86024de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcc6263e-654b-4350-bd4f-8aa5a86024de', 'volume_size': 1} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721974802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc6263e-654b-4350-bd4f-8aa5a86024de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:34Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Creating volume dcc6263e-654b-4350-bd4f-8aa5a86024de {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:50:34 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:34 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05" returned: 0 in 0.483s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:34 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de 1073741824 Sep 05 04:50:34 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:34 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05 Sep 05 04:50:34 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:34 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-8fe9f1d0-bd90-44b5-8402-5103e0c79bf1 req-b2d9f7a8-bc28-4bc4-84af-8d040d41136d tempest-AttachVolumeNegativeTest-340087041 None] Terminate volume connection completed successfully. Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-8fe9f1d0-bd90-44b5-8402-5103e0c79bf1 req-b2d9f7a8-bc28-4bc4-84af-8d040d41136d tempest-AttachVolumeNegativeTest-340087041 None] Deleting attachment 1f5d827f-9e2f-4ba9-810c-a2541f5c8f9b. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:50:34 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1342e6b2-da8d-4c75-9a02-116606051d05" returned: 0 in 0.281s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-quobyte-1342e6b2-da8d-4c75-9a02-116606051d05" released by "delete_volume" :: held 0.810s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Created reservations ['ffe95dfe-7bcb-4382-aab1-cab21be9d3db', '359e9838-bba5-4433-972e-428ae15d627d', '46ac24c5-eac4-4b4e-a940-1509908f5567', '78b2123a-ddfc-49d0-becd-87c865c16d66'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:35 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:35 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:35 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de 1073741824" returned: 0 in 0.485s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:35 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de Sep 05 04:50:35 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:35 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.281s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Deleted volume successfully. Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-19d6aacc-7fd5-4a75-8901-06f2ecf21de6 tempest-SnapshotDependencyTests-326645547 None] Lock "cinder-1342e6b2-da8d-4c75-9a02-116606051d05-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:35 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de" returned: 0 in 0.300s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45adda0c-4d4d-4ac5-a46a-07c04c6e281a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcc6263e-654b-4350-bd4f-8aa5a86024de', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c9a9bc-e915-4e7a-b9cd-a23124c966a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:35 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume volume-dcc6263e-654b-4350-bd4f-8aa5a86024de (dcc6263e-654b-4350-bd4f-8aa5a86024de): created successfully Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c9a9bc-e915-4e7a-b9cd-a23124c966a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (811f8bde-9bf2-4ab2-a4fa-46821d45b675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-cbe024c7-d072-436c-891e-c1fa5a7b940f tempest-CreateVolumesFromSnapshotTest-335080832 None] Created volume successfully. Sep 05 04:50:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Creating offline snapshot 622c929f-f75a-4e69-8b76-26d17744dba1 of volume dcc6263e-654b-4350-bd4f-8aa5a86024de {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:50:36 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5702a93-df48-4dd8-b3f2-dd6e97b3e2ee]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:36 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de Sep 05 04:50:36 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:37 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:37 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 1G Sep 05 04:50:37 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:37 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 1G" returned: 0 in 0.441s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc6263e-654b-4350-bd4f-8aa5a86024de -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:37 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc6263e-654b-4350-bd4f-8aa5a86024de -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 Sep 05 04:50:37 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:37 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc6263e-654b-4350-bd4f-8aa5a86024de -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1" returned: 0 in 0.328s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:37 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 is being set with open permissions: ugo+rw Sep 05 04:50:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:38 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 Sep 05 04:50:38 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:38 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1" returned: 0 in 0.334s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:38 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.info Sep 05 04:50:38 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:38 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.info" returned: 0 in 0.359s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:38 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.info is being set with open permissions: ugo+rw Sep 05 04:50:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:38 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.info Sep 05 04:50:38 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:39 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.info" returned: 0 in 0.277s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7743280c-c64e-4599-841c-41a5e780f220 tempest-CreateVolumesFromSnapshotTest-335080832 None] Create snapshot completed successfully Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (65398f59-1fc7-4b2f-8792-217422a562ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f55924b-a95f-4a01-897b-7fd8229bb4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f55924b-a95f-4a01-897b-7fd8229bb4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1496666925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad414c0-805c-4a05-abba-8f4cb9a9a5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:40Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7490bca4-a4ba-41b6-a30d-1caec1b020e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7490bca4-a4ba-41b6-a30d-1caec1b020e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3582ebd-356c-4302-957e-49450e25753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3582ebd-356c-4302-957e-49450e25753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad414c0-805c-4a05-abba-8f4cb9a9a5ed', 'volume_name': 'volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44bf6e7-91c7-43fe-abfd-ac4a92930d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44bf6e7-91c7-43fe-abfd-ac4a92930d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8993e4f-7913-4d83-9527-8741bb141b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:40 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume aad414c0-805c-4a05-abba-8f4cb9a9a5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed', 'volume_size': 1} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1496666925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad414c0-805c-4a05-abba-8f4cb9a9a5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:40Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Creating volume aad414c0-805c-4a05-abba-8f4cb9a9a5ed {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:50:40 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:50:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:40 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed 1073741824 Sep 05 04:50:40 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (f59a540b-d1b2-49f1-a1b5-02e5e411b4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807ddff6-aac9-40a1-9317-241e5080ab65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807ddff6-aac9-40a1-9317-241e5080ab65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1197449420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec6ec61-143a-492e-8927-bb8b2af3b444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:41Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27841e0a-e32a-4ee2-b48d-52957c6cda7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27841e0a-e32a-4ee2-b48d-52957c6cda7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c6a211-821b-477f-a35a-26a3b5106771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c6a211-821b-477f-a35a-26a3b5106771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec6ec61-143a-492e-8927-bb8b2af3b444', 'volume_name': 'volume-9ec6ec61-143a-492e-8927-bb8b2af3b444', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ce4a5f-c550-4604-99b9-47abeb00b146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ce4a5f-c550-4604-99b9-47abeb00b146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:41 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5dc9861-49e6-4dff-904c-d6c1c49d224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume 9ec6ec61-143a-492e-8927-bb8b2af3b444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec6ec61-143a-492e-8927-bb8b2af3b444', 'volume_size': 1} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed 1073741824" returned: 0 in 0.728s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:41 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed Sep 05 04:50:41 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (e80c358b-b1bd-49ee-a91f-5ee2d138cdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bed85c-970b-4e80-b476-a836cb6cd9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bed85c-970b-4e80-b476-a836cb6cd9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-442575517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8729e26-6cc5-4e10-9a9d-745f1e861e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:42Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15b865e-5d00-4310-9e84-6a7f5eeb9e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15b865e-5d00-4310-9e84-6a7f5eeb9e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9856f7ed-c15c-455b-9d53-ee8b4a8a437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9856f7ed-c15c-455b-9d53-ee8b4a8a437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8729e26-6cc5-4e10-9a9d-745f1e861e84', 'volume_name': 'volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c382d37-620b-46b2-89b9-1cea89c6e979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c382d37-620b-46b2-89b9-1cea89c6e979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bc2c5e-35d6-41ba-9ffe-06a6aaa2c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume a8729e26-6cc5-4e10-9a9d-745f1e861e84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84', 'volume_size': 1} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:41 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed" returned: 0 in 0.400s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1197449420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec6ec61-143a-492e-8927-bb8b2af3b444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:41Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Creating volume 9ec6ec61-143a-492e-8927-bb8b2af3b444 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:50:41 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8993e4f-7913-4d83-9527-8741bb141b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9b12cd-4f80-4ed0-b2a5-adf3e57b9fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:41 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444 1073741824 Sep 05 04:50:41 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed (aad414c0-805c-4a05-abba-8f4cb9a9a5ed): created successfully Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9b12cd-4f80-4ed0-b2a5-adf3e57b9fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (65398f59-1fc7-4b2f-8792-217422a562ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-897e3b96-1260-49fe-be2d-016c6eec229b tempest-CreateVolumesFromSnapshotTest-335080832 None] Created volume successfully. Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (bcf7e390-884f-4ab9-a51c-36d732471741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8758b901-a425-40e6-acae-91d1df6e3398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8758b901-a425-40e6-acae-91d1df6e3398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116710802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912ebdec-5bc2-433d-84f8-fe998cb5dd23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:42Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f20d067-d99a-4015-8462-851f038c6417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f20d067-d99a-4015-8462-851f038c6417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c5c3b3-00cc-4038-ab44-e602c3754680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c5c3b3-00cc-4038-ab44-e602c3754680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912ebdec-5bc2-433d-84f8-fe998cb5dd23', 'volume_name': 'volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6326e3ca-9087-4194-a66e-f9698bb8835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6326e3ca-9087-4194-a66e-f9698bb8835c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfd289c-545f-48dc-ad08-c74d4c5782c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume 912ebdec-5bc2-433d-84f8-fe998cb5dd23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23', 'volume_size': 1} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:42 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444 1073741824" returned: 0 in 0.691s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:42 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444 Sep 05 04:50:42 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (fb9860e5-d9cb-4861-906f-8500f7be8eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832c7098-1268-49d2-95e8-47d842e79379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832c7098-1268-49d2-95e8-47d842e79379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912429201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595f483c-ee91-40b2-8114-6a906e1ac19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:43Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225dcbc6-cc42-49a4-b4e9-f5fd4e587a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225dcbc6-cc42-49a4-b4e9-f5fd4e587a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20afb132-d3b0-4599-9224-9ab099c3e801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20afb132-d3b0-4599-9224-9ab099c3e801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595f483c-ee91-40b2-8114-6a906e1ac19c', 'volume_name': 'volume-595f483c-ee91-40b2-8114-6a906e1ac19c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f961c6-612c-43b7-8fa2-d11b2023e2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:43 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f961c6-612c-43b7-8fa2-d11b2023e2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ffb820-5100-49ad-a9af-2b511063991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:43 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume 595f483c-ee91-40b2-8114-6a906e1ac19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595f483c-ee91-40b2-8114-6a906e1ac19c', 'volume_size': 1} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444" returned: 0 in 0.314s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-442575517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8729e26-6cc5-4e10-9a9d-745f1e861e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:42Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Creating volume a8729e26-6cc5-4e10-9a9d-745f1e861e84 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:50:43 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5dc9861-49e6-4dff-904c-d6c1c49d224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec6ec61-143a-492e-8927-bb8b2af3b444', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f67eb9-cfec-4777-a3f9-5f52e77f0c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:43 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84 1073741824 Sep 05 04:50:43 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:43 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume volume-9ec6ec61-143a-492e-8927-bb8b2af3b444 (9ec6ec61-143a-492e-8927-bb8b2af3b444): created successfully Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f67eb9-cfec-4777-a3f9-5f52e77f0c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (f59a540b-d1b2-49f1-a1b5-02e5e411b4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:43 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d66029e4-909e-4dc5-8033-8ac806dfdc10 tempest-CreateVolumesFromSnapshotTest-335080832 None] Created volume successfully. Sep 05 04:50:43 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84 1073741824" returned: 0 in 0.522s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:43 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84 Sep 05 04:50:43 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:43 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84" returned: 0 in 0.318s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.288s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116710802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912ebdec-5bc2-433d-84f8-fe998cb5dd23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:42Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Creating volume 912ebdec-5bc2-433d-84f8-fe998cb5dd23 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:50:43 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:43 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23 1073741824 Sep 05 04:50:43 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bc2c5e-35d6-41ba-9ffe-06a6aaa2c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8148f6f4-df44-423c-ad1b-8eb1c303c255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:43 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84 (a8729e26-6cc5-4e10-9a9d-745f1e861e84): created successfully Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8148f6f4-df44-423c-ad1b-8eb1c303c255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (e80c358b-b1bd-49ee-a91f-5ee2d138cdbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7e58f024-82d8-451c-8428-757152b6d583 tempest-CreateVolumesFromSnapshotTest-335080832 None] Created volume successfully. Sep 05 04:50:44 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23 1073741824" returned: 0 in 0.545s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:44 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23 Sep 05 04:50:44 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:44 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23" returned: 0 in 0.270s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.786s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912429201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595f483c-ee91-40b2-8114-6a906e1ac19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37c74ed81a415aa44803dbd29d8e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:50:43Z,use_quota=True,user_id='7e238f63eab64178bd59e1dce36e1495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Creating volume 595f483c-ee91-40b2-8114-6a906e1ac19c {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:50:44 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfd289c-545f-48dc-ad08-c74d4c5782c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:44 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c 1073741824 Sep 05 04:50:44 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace5d25c-6ae7-433b-b860-69e55bada720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:44 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23 (912ebdec-5bc2-433d-84f8-fe998cb5dd23): created successfully Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace5d25c-6ae7-433b-b860-69e55bada720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (bcf7e390-884f-4ab9-a51c-36d732471741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3a002f18-a105-444d-b75f-bf999219b244 tempest-CreateVolumesFromSnapshotTest-335080832 None] Created volume successfully. Sep 05 04:50:45 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c 1073741824" returned: 0 in 0.527s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:45 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c Sep 05 04:50:45 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:45 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:50:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ffb820-5100-49ad-a9af-2b511063991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595f483c-ee91-40b2-8114-6a906e1ac19c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07870ba6-5e32-44ca-b248-2189fd316a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:50:45 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Volume volume-595f483c-ee91-40b2-8114-6a906e1ac19c (595f483c-ee91-40b2-8114-6a906e1ac19c): created successfully Sep 05 04:50:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07870ba6-5e32-44ca-b248-2189fd316a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:50:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Flow 'volume_create_manager' (fb9860e5-d9cb-4861-906f-8500f7be8eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:50:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-233ea774-3372-4e30-a30c-07c7bce51d4b tempest-CreateVolumesFromSnapshotTest-335080832 None] Created volume successfully. Sep 05 04:50:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-595f483c-ee91-40b2-8114-6a906e1ac19c-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-595f483c-ee91-40b2-8114-6a906e1ac19c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-quobyte-595f483c-ee91-40b2-8114-6a906e1ac19c" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-595f483c-ee91-40b2-8114-6a906e1ac19c" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:46 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aea63e-b40a-4ff6-87b6-e6969e766bb9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:46 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c Sep 05 04:50:46 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:47 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c" returned: 0 in 0.589s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:47 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c Sep 05 04:50:47 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:47 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-595f483c-ee91-40b2-8114-6a906e1ac19c" returned: 0 in 0.264s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-595f483c-ee91-40b2-8114-6a906e1ac19c" released by "delete_volume" :: held 0.902s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Created reservations ['4cef6dd9-0506-40c0-a3a1-f0ad8787f431', '6abea4c8-9fb0-4e82-bdcd-c30531161944', '7e46dc21-fe53-48ba-b6a8-e60d414be46b', 'e439f370-ff7f-4fac-8747-44abce9f73e1'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:47 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:47 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-912ebdec-5bc2-433d-84f8-fe998cb5dd23-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-912ebdec-5bc2-433d-84f8-fe998cb5dd23-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-quobyte-912ebdec-5bc2-433d-84f8-fe998cb5dd23" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-912ebdec-5bc2-433d-84f8-fe998cb5dd23" acquired by "delete_volume" :: waited 0.040s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8968f-4a6a-4b4c-97d6-966ce97423ba]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:47 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.395s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:47 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Deleted volume successfully. Sep 05 04:50:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69a973cf-02fc-488b-8dcd-394bd2f235f1 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-595f483c-ee91-40b2-8114-6a906e1ac19c-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:48 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23 Sep 05 04:50:48 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:48 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23" returned: 0 in 0.672s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:48 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23 Sep 05 04:50:48 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:48 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-912ebdec-5bc2-433d-84f8-fe998cb5dd23" returned: 0 in 0.365s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-912ebdec-5bc2-433d-84f8-fe998cb5dd23" released by "delete_volume" :: held 1.110s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:48 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Created reservations ['067ad735-1591-4fce-a4ed-db160cfb59c6', '667afec3-47b0-4462-8c20-3c991b01262c', '1fdd7481-c432-4a3b-9a0a-80e6dec4076d', '0de02eaf-91d5-40db-b0c8-f33121f501cc'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:49 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:49 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:49 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.469s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:49 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:49 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Deleted volume successfully. Sep 05 04:50:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-25653e16-41a0-40d3-8e3f-38f7104b2fd5 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-912ebdec-5bc2-433d-84f8-fe998cb5dd23-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-a8729e26-6cc5-4e10-9a9d-745f1e861e84-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-a8729e26-6cc5-4e10-9a9d-745f1e861e84-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-quobyte-a8729e26-6cc5-4e10-9a9d-745f1e861e84" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-a8729e26-6cc5-4e10-9a9d-745f1e861e84" acquired by "delete_volume" :: waited 0.038s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:50 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d02824-637e-4c18-bb1b-0aca7f6923ff]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:50 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84 Sep 05 04:50:50 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:50 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84" returned: 0 in 0.511s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:50 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84 Sep 05 04:50:50 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:50 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a8729e26-6cc5-4e10-9a9d-745f1e861e84" returned: 0 in 0.272s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-a8729e26-6cc5-4e10-9a9d-745f1e861e84" released by "delete_volume" :: held 0.835s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Created reservations ['b02b27fd-cb7a-43b6-8748-4bf1c44d464c', '1f72dd85-171b-48fd-9dc8-0ccc36c3ec49', '30d2aed6-90b9-4708-8fb5-f868029ed662', '7007d374-7f45-4f18-9652-03f7c01e131e'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:51 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:51 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-9ec6ec61-143a-492e-8927-bb8b2af3b444-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-9ec6ec61-143a-492e-8927-bb8b2af3b444-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-quobyte-9ec6ec61-143a-492e-8927-bb8b2af3b444" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-9ec6ec61-143a-492e-8927-bb8b2af3b444" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b726edcc-6d4f-4923-ba0d-35899567cf86]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:51 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444 Sep 05 04:50:51 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:51 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.357s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:51 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Deleted volume successfully. Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-beaf1db8-f31b-451a-98be-5f6c5e05a1a6 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-a8729e26-6cc5-4e10-9a9d-745f1e861e84-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:51 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444" returned: 0 in 0.391s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:51 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444 Sep 05 04:50:51 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:52 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9ec6ec61-143a-492e-8927-bb8b2af3b444" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-9ec6ec61-143a-492e-8927-bb8b2af3b444" released by "delete_volume" :: held 0.719s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Created reservations ['28070edf-4d60-42a5-93ee-3c758b4bd880', 'a72e9980-2790-423f-b76d-04b7ce51f3dc', 'd14d4ef7-e9bc-4428-977d-6e140b29f5fe', '03035886-7740-465d-abae-299c83a18cd0'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:52 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:52 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:52 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.262s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Deleted volume successfully. Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a83cf2e-6c05-4399-9aeb-cb0f88bb137d tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-9ec6ec61-143a-492e-8927-bb8b2af3b444-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-aad414c0-805c-4a05-abba-8f4cb9a9a5ed-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-aad414c0-805c-4a05-abba-8f4cb9a9a5ed-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-quobyte-aad414c0-805c-4a05-abba-8f4cb9a9a5ed" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-aad414c0-805c-4a05-abba-8f4cb9a9a5ed" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5996839-a647-46b3-80d3-4e186ac4bc9f]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:52 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed Sep 05 04:50:52 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:53 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed" returned: 0 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:53 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed Sep 05 04:50:53 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:53 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-aad414c0-805c-4a05-abba-8f4cb9a9a5ed" returned: 0 in 0.259s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-aad414c0-805c-4a05-abba-8f4cb9a9a5ed" released by "delete_volume" :: held 0.699s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Created reservations ['7d22db12-e671-4d8f-ad20-42c019fc5b94', '8425221d-b8d7-4797-9cb5-b5243a9d735c', 'ff62a420-0717-4e43-a6d5-6fd5ce0689fe', '9819b8e4-8612-4de7-b86d-0e3c32d29e18'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:53 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:53 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-622c929f-f75a-4e69-8b76-26d17744dba1-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:53 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.316s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-622c929f-f75a-4e69-8b76-26d17744dba1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-quobyte-dcc6263e-654b-4350-bd4f-8aa5a86024de" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Deleted volume successfully. Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-dcc6263e-654b-4350-bd4f-8aa5a86024de" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-quobyte-622c929f-f75a-4e69-8b76-26d17744dba1" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-622c929f-f75a-4e69-8b76-26d17744dba1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Deleting offline snapshot 622c929f-f75a-4e69-8b76-26d17744dba1 of volume dcc6263e-654b-4350-bd4f-8aa5a86024de {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] snapshot_file for this snap is: volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc7fdf9e-d6a3-440f-a75d-1c7bed2b7aed tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-aad414c0-805c-4a05-abba-8f4cb9a9a5ed-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35d88b2-402a-4214-a05a-3db056d7641d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:54 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 Sep 05 04:50:54 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:54 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1" returned: 0 in 0.384s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc6263e-654b-4350-bd4f-8aa5a86024de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:50:54 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b894d97-1a16-460b-a5ed-36a393bbff1f]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:54 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de Sep 05 04:50:54 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:54 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de" returned: 0 in 0.408s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:54 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 Sep 05 04:50:54 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:55 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1" returned: 0 in 0.364s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:55 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1 Sep 05 04:50:55 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:55 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de.622c929f-f75a-4e69-8b76-26d17744dba1" returned: 0 in 0.269s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-622c929f-f75a-4e69-8b76-26d17744dba1" released by "_delete_snapshot" :: held 1.538s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-dcc6263e-654b-4350-bd4f-8aa5a86024de" released by "delete_snapshot" :: held 1.572s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:55 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Created reservations ['f3c1bece-658d-4d07-bef6-92fde36ea942', '487e1ffa-8096-436f-ac68-4367d5bbc683', 'fbeb814a-ad65-41e3-a438-c36c72a42e0d', '0dc946c7-6213-41d8-aa2c-cb8b0d6f4d12'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:55 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Delete snapshot completed successfully. Sep 05 04:50:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-34ff41b9-cd9d-4966-9d37-686db86e5cd0 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-622c929f-f75a-4e69-8b76-26d17744dba1-delete_snapshot" released by "delete_snapshot" :: held 1.727s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-dcc6263e-654b-4350-bd4f-8aa5a86024de-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-dcc6263e-654b-4350-bd4f-8aa5a86024de-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "cinder-quobyte-dcc6263e-654b-4350-bd4f-8aa5a86024de" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-dcc6263e-654b-4350-bd4f-8aa5a86024de" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f5e548-8204-4114-b9dd-fff4d6457be8]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:56 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de Sep 05 04:50:56 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:56 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de" returned: 0 in 0.358s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:56 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de Sep 05 04:50:56 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:56 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dcc6263e-654b-4350-bd4f-8aa5a86024de" returned: 0 in 0.257s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-quobyte-dcc6263e-654b-4350-bd4f-8aa5a86024de" released by "delete_volume" :: held 0.687s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Created reservations ['edaee3ea-438c-4511-805a-4149a06e76fe', '9714f1ed-b245-4b04-933e-1f32d89fdc1b', 'ab30414c-4773-4dac-b690-d37fc402591a', '625fd045-50c6-4595-bbc5-a158fa6faa02'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:50:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:50:56 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:50:56 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:50:57 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Sep 05 04:50:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:50:57 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:50:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Deleted volume successfully. Sep 05 04:50:57 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d3de5a04-098e-4b35-9e15-a56ff55e3511 tempest-CreateVolumesFromSnapshotTest-335080832 None] Lock "cinder-dcc6263e-654b-4350-bd4f-8aa5a86024de-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Flow 'volume_create_manager' (0584c2db-726a-4d2e-9961-97277952876f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65fc6ca6-9ec5-4704-800a-e077654da5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65fc6ca6-9ec5-4704-800a-e077654da5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1873279039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eabbd47-fa35-4ef6-a002-52bb0b682ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa89ef8ff047e085ffe68befa555a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:00Z,use_quota=True,user_id='b6460d92bd544253b8fe6164b3e2b653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbc520f-e1d0-4e07-8a4c-6cf12cd54492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbc520f-e1d0-4e07-8a4c-6cf12cd54492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7136f1-35b9-4567-8e2d-a1f718363cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7136f1-35b9-4567-8e2d-a1f718363cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eabbd47-fa35-4ef6-a002-52bb0b682ef8', 'volume_name': 'volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f90ee41-40c6-491f-825e-f0553aa39fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f90ee41-40c6-491f-825e-f0553aa39fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28eb8b0b-141d-4f4e-b4ac-c4e07e72bf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:00 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Volume 5eabbd47-fa35-4ef6-a002-52bb0b682ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8', 'volume_size': 1} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1873279039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eabbd47-fa35-4ef6-a002-52bb0b682ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa89ef8ff047e085ffe68befa555a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:00Z,use_quota=True,user_id='b6460d92bd544253b8fe6164b3e2b653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Creating volume 5eabbd47-fa35-4ef6-a002-52bb0b682ef8 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:51:00 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:00 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 1073741824 Sep 05 04:51:00 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:00 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 1073741824" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:00 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 Sep 05 04:51:00 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:00 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" returned: 0 in 0.250s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28eb8b0b-141d-4f4e-b4ac-c4e07e72bf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8277dd-eb5e-4782-b5e0-1d555c30dc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:00 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Volume volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 (5eabbd47-fa35-4ef6-a002-52bb0b682ef8): created successfully Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8277dd-eb5e-4782-b5e0-1d555c30dc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Flow 'volume_create_manager' (0584c2db-726a-4d2e-9961-97277952876f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:00 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8c588e7c-c9d3-4a48-b07b-cdcf86819e4a tempest-VolumeDependencyTests-210634349 None] Created volume successfully. Sep 05 04:51:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Creating offline snapshot 759f20a4-bc2b-409f-beac-1bb868c75053 of volume 5eabbd47-fa35-4ef6-a002-52bb0b682ef8 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:51:01 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc085a57-123b-40ba-8a66-3afa0b128dd3]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:01 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 Sep 05 04:51:01 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:01 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" returned: 0 in 0.368s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:01 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 1G Sep 05 04:51:01 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:02 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 1G" returned: 0 in 0.388s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:02 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 Sep 05 04:51:02 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:02 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053" returned: 0 in 0.303s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:02 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 is being set with open permissions: ugo+rw Sep 05 04:51:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:02 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 Sep 05 04:51:02 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:02 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053" returned: 0 in 0.264s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:02 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.info Sep 05 04:51:02 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:03 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.info" returned: 0 in 0.280s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:03 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.info is being set with open permissions: ugo+rw Sep 05 04:51:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:03 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.info Sep 05 04:51:03 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:03 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.info" returned: 0 in 0.267s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:03 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4edda6d1-9a3e-4daf-b82a-ecb00c0ce7aa tempest-VolumeDependencyTests-210634349 None] Create snapshot completed successfully Sep 05 04:51:03 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Flow 'volume_create_manager' (9a42d409-c85d-433a-8ac8-1483163f831a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34e56db-51e9-4d3a-92e9-c5cdaa87afd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34e56db-51e9-4d3a-92e9-c5cdaa87afd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1981743850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee69f5c8-4081-4282-82f0-0d52b700f343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aa89ef8ff047e085ffe68befa555a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=759f20a4-bc2b-409f-beac-1bb868c75053,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:04Z,use_quota=True,user_id='b6460d92bd544253b8fe6164b3e2b653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ed8983-e954-4c5c-9b8e-36c6af16c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ed8983-e954-4c5c-9b8e-36c6af16c66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef0f843-132b-4902-8445-ba946aad1147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef0f843-132b-4902-8445-ba946aad1147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee69f5c8-4081-4282-82f0-0d52b700f343', 'volume_name': 'volume-ee69f5c8-4081-4282-82f0-0d52b700f343', 'volume_size': 1, 'snapshot_id': '759f20a4-bc2b-409f-beac-1bb868c75053'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd1b585-5c42-46b1-b8cc-f01afb3d233d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd1b585-5c42-46b1-b8cc-f01afb3d233d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035b5746-1e12-451c-b338-ccc73ce1c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:04 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Volume ee69f5c8-4081-4282-82f0-0d52b700f343: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee69f5c8-4081-4282-82f0-0d52b700f343', 'volume_size': 1, 'snapshot_id': '759f20a4-bc2b-409f-beac-1bb868c75053'} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Acquiring lock "cinder-quobyte-759f20a4-bc2b-409f-beac-1bb868c75053-ee69f5c8-4081-4282-82f0-0d52b700f343" by "_create_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-759f20a4-bc2b-409f-beac-1bb868c75053-ee69f5c8-4081-4282-82f0-0d52b700f343" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Creating volume ee69f5c8-4081-4282-82f0-0d52b700f343 from snapshot 759f20a4-bc2b-409f-beac-1bb868c75053 {{(pid=89807) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Acquiring lock "cinder-quobyte-ee69f5c8-4081-4282-82f0-0d52b700f343" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-ee69f5c8-4081-4282-82f0-0d52b700f343" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] snapshot: 759f20a4-bc2b-409f-beac-1bb868c75053, volume: ee69f5c8-4081-4282-82f0-0d52b700f343, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa62c1ba-2b18-4e9c-aaf0-6e8a398e6c32]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:04 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 Sep 05 04:51:04 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:04 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053" returned: 0 in 0.351s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aa612e-6241-49ad-ad52-bba6a0a6ca9d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:04 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 Sep 05 04:51:04 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:04 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" returned: 0 in 0.357s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:51:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:04 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 Sep 05 04:51:04 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:09 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343" returned: 0 in 4.252s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8, size 1024.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:51:09 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Converted 1024.00 MB image at 240.73 MB/s Sep 05 04:51:09 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 is being set with open permissions: ugo+rw Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:09 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 Sep 05 04:51:09 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:09 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343" returned: 0 in 0.240s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-ee69f5c8-4081-4282-82f0-0d52b700f343" released by "_copy_volume_from_snapshot" :: held 5.276s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=134,cinder:SELECT=106,cinder:INSERT=26,cinder:DELETE=10 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=113,cinder:UPDATE=132,cinder:INSERT=44,cinder:DELETE=14 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-759f20a4-bc2b-409f-beac-1bb868c75053-ee69f5c8-4081-4282-82f0-0d52b700f343" released by "_create_volume_from_snapshot" :: held 5.353s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.372s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035b5746-1e12-451c-b338-ccc73ce1c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee69f5c8-4081-4282-82f0-0d52b700f343', 'volume_size': 1, 'snapshot_id': '759f20a4-bc2b-409f-beac-1bb868c75053'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80b4952-1d7a-4ca3-aa55-73b9921ab777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:09 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Volume volume-ee69f5c8-4081-4282-82f0-0d52b700f343 (ee69f5c8-4081-4282-82f0-0d52b700f343): created successfully Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80b4952-1d7a-4ca3-aa55-73b9921ab777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Flow 'volume_create_manager' (9a42d409-c85d-433a-8ac8-1483163f831a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:09 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-674d46fd-272c-4960-856b-4638c5a44ee0 tempest-VolumeDependencyTests-210634349 None] Created volume successfully. Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Acquiring lock "cinder-759f20a4-bc2b-409f-beac-1bb868c75053-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Lock "cinder-759f20a4-bc2b-409f-beac-1bb868c75053-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Acquiring lock "cinder-quobyte-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Acquiring lock "cinder-quobyte-759f20a4-bc2b-409f-beac-1bb868c75053" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-759f20a4-bc2b-409f-beac-1bb868c75053" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:10 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:10 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Deleting offline snapshot 759f20a4-bc2b-409f-beac-1bb868c75053 of volume 5eabbd47-fa35-4ef6-a002-52bb0b682ef8 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] snapshot_file for this snap is: volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc468ad-35bb-4191-91e1-46854d6a3a67]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:10 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 Sep 05 04:51:10 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:10 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.255s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:51:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:51:11 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053" returned: 0 in 0.376s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:51:11 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dc23f9-9c7c-4ec7-aa89-e49118793c80]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:11 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 Sep 05 04:51:11 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:11 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" returned: 0 in 0.581s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:11 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 Sep 05 04:51:11 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:12 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053" returned: 0 in 0.336s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:12 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053 Sep 05 04:51:12 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:12 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8.759f20a4-bc2b-409f-beac-1bb868c75053" returned: 0 in 0.241s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-759f20a4-bc2b-409f-beac-1bb868c75053" released by "_delete_snapshot" :: held 1.635s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" released by "delete_snapshot" :: held 1.681s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Created reservations ['63b58f1a-afca-4a3d-94d3-081e2fa7afc2', 'c7ce6c31-4628-4403-9450-df958ec01f48', '83942f58-1efc-4434-a0ff-4e93edd3d202', 'db0484f1-a3d7-42be-b1a3-d4c9e3cf12ba'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:12 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Delete snapshot completed successfully. Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5dafec74-ee60-442a-afd6-d8904836a23c tempest-VolumeDependencyTests-210634349 None] Lock "cinder-759f20a4-bc2b-409f-beac-1bb868c75053-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Acquiring lock "cinder-5eabbd47-fa35-4ef6-a002-52bb0b682ef8-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Lock "cinder-5eabbd47-fa35-4ef6-a002-52bb0b682ef8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Acquiring lock "cinder-quobyte-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb42632a-269a-469b-87e0-488b3f3c0eb9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:13 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 Sep 05 04:51:13 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:13 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" returned: 0 in 0.349s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:13 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8 Sep 05 04:51:13 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:13 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" returned: 0 in 0.256s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-5eabbd47-fa35-4ef6-a002-52bb0b682ef8" released by "delete_volume" :: held 0.657s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Created reservations ['ffbac2d4-476d-4d89-af08-54661facc66b', 'e0959f0c-3f7d-4fe9-b916-f35539962c6a', '9c494586-8b8b-4822-b83d-2c97b25eb837', 'c532f2f1-808a-4aaf-ac68-febdfc1413bf'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:13 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:13 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:13 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:13 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Deleted volume successfully. Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-b303fe9d-27a6-4e04-b2c1-fa9d338c630a tempest-VolumeDependencyTests-210634349 None] Lock "cinder-5eabbd47-fa35-4ef6-a002-52bb0b682ef8-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Acquiring lock "cinder-ee69f5c8-4081-4282-82f0-0d52b700f343-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Lock "cinder-ee69f5c8-4081-4282-82f0-0d52b700f343-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Acquiring lock "cinder-quobyte-ee69f5c8-4081-4282-82f0-0d52b700f343" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-ee69f5c8-4081-4282-82f0-0d52b700f343" acquired by "delete_volume" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[119ab17b-b6a9-4936-91fc-4c08122f64bf]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:14 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 Sep 05 04:51:14 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Flow 'volume_create_manager' (246e969b-d811-425d-a18b-8d4f739c1b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db4baeb-96ba-462f-8392-c2f28d4cebfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db4baeb-96ba-462f-8392-c2f28d4cebfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-364013115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffd365a-aad9-4137-b614-ffcbfee65be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8f15735d6849599f6d4cb1b7d52500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:14Z,use_quota=True,user_id='886e0cc81aff46cea32d725d8daf0a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfa0ae1-e704-4729-b480-572803f79970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfa0ae1-e704-4729-b480-572803f79970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cc5c27-064b-4ebe-b4f1-5fec15ecc14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cc5c27-064b-4ebe-b4f1-5fec15ecc14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ffd365a-aad9-4137-b614-ffcbfee65be0', 'volume_name': 'volume-0ffd365a-aad9-4137-b614-ffcbfee65be0', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a59daf-4a10-4dbe-bb7f-bcd3716e8fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a59daf-4a10-4dbe-bb7f-bcd3716e8fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f93ea45-eb5d-4a3a-81fc-8de98ba4fdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:14 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Volume 0ffd365a-aad9-4137-b614-ffcbfee65be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ffd365a-aad9-4137-b614-ffcbfee65be0', 'volume_size': 1} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-364013115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffd365a-aad9-4137-b614-ffcbfee65be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8f15735d6849599f6d4cb1b7d52500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:14Z,use_quota=True,user_id='886e0cc81aff46cea32d725d8daf0a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Creating volume 0ffd365a-aad9-4137-b614-ffcbfee65be0 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:51:14 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:14 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0 1073741824 Sep 05 04:51:14 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:14 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343" returned: 0 in 0.392s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:14 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343 Sep 05 04:51:14 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:14 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ee69f5c8-4081-4282-82f0-0d52b700f343" returned: 0 in 0.260s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Lock "cinder-quobyte-ee69f5c8-4081-4282-82f0-0d52b700f343" released by "delete_volume" :: held 0.701s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Created reservations ['0002e6d8-c772-4393-960c-00c78d085bf8', 'fc7adb78-ce03-478b-8f3f-818910643131', '45880b93-d204-4e8f-82ea-d0aa1a99508a', '68446fc4-0840-4e5c-8f41-9a2eb3159dda'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:14 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0 1073741824" returned: 0 in 0.451s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:14 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:14 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:14 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0 Sep 05 04:51:14 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:15 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.240s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:15 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Deleted volume successfully. Sep 05 04:51:15 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0" returned: 0 in 0.266s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e598ff5b-df2a-4d6f-9b3a-d8cb1a4cfb72 tempest-VolumeDependencyTests-210634349 None] Lock "cinder-ee69f5c8-4081-4282-82f0-0d52b700f343-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f93ea45-eb5d-4a3a-81fc-8de98ba4fdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ffd365a-aad9-4137-b614-ffcbfee65be0', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdd2b50-18ce-4939-a34a-5a1695728c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:15 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Volume volume-0ffd365a-aad9-4137-b614-ffcbfee65be0 (0ffd365a-aad9-4137-b614-ffcbfee65be0): created successfully Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdd2b50-18ce-4939-a34a-5a1695728c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Flow 'volume_create_manager' (246e969b-d811-425d-a18b-8d4f739c1b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:15 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-82991816-5bd9-4da9-8899-ab9678530126 tempest-AttachVolumeNegativeTest-340087041 None] Created volume successfully. Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-fee64a4a-d0e6-495a-8c06-8beed0d62210 req-4b269296-98fc-406e-81dc-379a924edebe tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-fee64a4a-d0e6-495a-8c06-8beed0d62210 req-4b269296-98fc-406e-81dc-379a924edebe tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-fee64a4a-d0e6-495a-8c06-8beed0d62210 req-4b269296-98fc-406e-81dc-379a924edebe tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-fee64a4a-d0e6-495a-8c06-8beed0d62210 req-4b269296-98fc-406e-81dc-379a924edebe tempest-AttachVolumeNegativeTest-340087041 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-0ffd365a-aad9-4137-b614-ffcbfee65be0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1868e97c-c108-44f7-8be9-03f5cb76cf65', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:51:16 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-fee64a4a-d0e6-495a-8c06-8beed0d62210 req-4b269296-98fc-406e-81dc-379a924edebe tempest-AttachVolumeNegativeTest-340087041 None] attachment_update completed successfully. Sep 05 04:51:18 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-8cdcd84e-3076-4876-bad7-20fd9ab8c4ec req-c23f2397-e2ed-449d-a626-11e9eb00175b tempest-AttachVolumeNegativeTest-340087041 None] Terminate volume connection completed successfully. Sep 05 04:51:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-8cdcd84e-3076-4876-bad7-20fd9ab8c4ec req-c23f2397-e2ed-449d-a626-11e9eb00175b tempest-AttachVolumeNegativeTest-340087041 None] Deleting attachment 1868e97c-c108-44f7-8be9-03f5cb76cf65. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:51:18 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:51:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Flow 'volume_create_manager' (aa9f3592-eeb7-42c8-b308-951ecec8a720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea9b5c0-9b50-4549-a435-31984d8b31e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea9b5c0-9b50-4549-a435-31984d8b31e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1009729068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c144ef-279f-4b78-8369-cf6abd4973b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732c00a8865545f5a92c4408904ea55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:19Z,use_quota=True,user_id='f5cd63a798ea4cb7978d5520d72db687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb9b54e-fa9a-43f3-984d-0edbf745e63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb9b54e-fa9a-43f3-984d-0edbf745e63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df83509-263b-43fe-94e1-40b46190094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df83509-263b-43fe-94e1-40b46190094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c144ef-279f-4b78-8369-cf6abd4973b5', 'volume_name': 'volume-90c144ef-279f-4b78-8369-cf6abd4973b5', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db4baf3-5b21-4091-ab8e-65fd22655ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db4baf3-5b21-4091-ab8e-65fd22655ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da2c6a1-f4b8-48ed-8664-05ba3b5bb054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:19 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Volume 90c144ef-279f-4b78-8369-cf6abd4973b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c144ef-279f-4b78-8369-cf6abd4973b5', 'volume_size': 1} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1009729068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c144ef-279f-4b78-8369-cf6abd4973b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732c00a8865545f5a92c4408904ea55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:19Z,use_quota=True,user_id='f5cd63a798ea4cb7978d5520d72db687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Creating volume 90c144ef-279f-4b78-8369-cf6abd4973b5 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:51:19 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:19 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5 1073741824 Sep 05 04:51:19 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:19 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5 1073741824" returned: 0 in 0.459s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:19 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5 Sep 05 04:51:19 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:19 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5" returned: 0 in 0.345s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da2c6a1-f4b8-48ed-8664-05ba3b5bb054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c144ef-279f-4b78-8369-cf6abd4973b5', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5515689c-855f-45cd-9b42-994b55069959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:19 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Volume volume-90c144ef-279f-4b78-8369-cf6abd4973b5 (90c144ef-279f-4b78-8369-cf6abd4973b5): created successfully Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5515689c-855f-45cd-9b42-994b55069959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:19 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Flow 'volume_create_manager' (aa9f3592-eeb7-42c8-b308-951ecec8a720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:19 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-61da1a12-7ce7-4627-b347-4ff1e5b368dd tempest-ProjectReaderTests-1835023499 None] Created volume successfully. Sep 05 04:51:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Acquiring lock "cinder-90c144ef-279f-4b78-8369-cf6abd4973b5-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Lock "cinder-90c144ef-279f-4b78-8369-cf6abd4973b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Acquiring lock "cinder-quobyte-90c144ef-279f-4b78-8369-cf6abd4973b5" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Lock "cinder-quobyte-90c144ef-279f-4b78-8369-cf6abd4973b5" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:21 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fda7c0-bf8c-4be3-8f40-5569a54bab45]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:21 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5 Sep 05 04:51:21 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:21 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5" returned: 0 in 0.410s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:21 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5 Sep 05 04:51:21 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:22 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-90c144ef-279f-4b78-8369-cf6abd4973b5" returned: 0 in 0.247s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Lock "cinder-quobyte-90c144ef-279f-4b78-8369-cf6abd4973b5" released by "delete_volume" :: held 0.703s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Created reservations ['3c6e0f86-1dde-4e3a-83f3-db2d722f7ee6', '7544f83c-0725-43e2-8127-53c5b29abf83', '9d3dbbcd-af99-4e19-bd5d-751560f63408', '263e4ef0-ebe8-4004-9331-40a682b190bc'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:22 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:22 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:22 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.314s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:22 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Deleted volume successfully. Sep 05 04:51:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d0dd24bd-b5dd-4f3c-a980-e04dc0bb101e tempest-ProjectReaderTests-1835023499 None] Lock "cinder-90c144ef-279f-4b78-8369-cf6abd4973b5-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Flow 'volume_create_manager' (509cf5c3-f0bc-47b4-b915-a66fde8eda24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf76005e-336c-453e-8dbe-7d51bc124fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf76005e-336c-453e-8dbe-7d51bc124fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820539400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0986ba5-102c-4272-975e-06c3297cb064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732c00a8865545f5a92c4408904ea55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:23Z,use_quota=True,user_id='f5cd63a798ea4cb7978d5520d72db687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c61fcef-8263-48c0-82b1-da1962412bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c61fcef-8263-48c0-82b1-da1962412bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfee8ae0-ce23-466b-9502-7069c5086b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfee8ae0-ce23-466b-9502-7069c5086b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0986ba5-102c-4272-975e-06c3297cb064', 'volume_name': 'volume-e0986ba5-102c-4272-975e-06c3297cb064', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52477a9d-bb43-4fb1-9e60-e6e77bcf1e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52477a9d-bb43-4fb1-9e60-e6e77bcf1e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc6bd31-2529-44fe-8c37-d8bd954bd059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:23 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Volume e0986ba5-102c-4272-975e-06c3297cb064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0986ba5-102c-4272-975e-06c3297cb064', 'volume_size': 1} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820539400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0986ba5-102c-4272-975e-06c3297cb064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732c00a8865545f5a92c4408904ea55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:23Z,use_quota=True,user_id='f5cd63a798ea4cb7978d5520d72db687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Creating volume e0986ba5-102c-4272-975e-06c3297cb064 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:51:23 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:23 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064 1073741824 Sep 05 04:51:23 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "cinder-0ffd365a-aad9-4137-b614-ffcbfee65be0-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-0ffd365a-aad9-4137-b614-ffcbfee65be0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "cinder-quobyte-0ffd365a-aad9-4137-b614-ffcbfee65be0" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-quobyte-0ffd365a-aad9-4137-b614-ffcbfee65be0" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9861111-47de-4a68-a637-dc313cbc72e5]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:23 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064 1073741824" returned: 0 in 0.465s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:23 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0 Sep 05 04:51:23 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:23 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064 Sep 05 04:51:23 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:23 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064" returned: 0 in 0.249s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:23 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc6bd31-2529-44fe-8c37-d8bd954bd059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0986ba5-102c-4272-975e-06c3297cb064', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142be3d0-a0e4-4fb5-857f-635d8b74b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0" returned: 0 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:23 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Volume volume-e0986ba5-102c-4272-975e-06c3297cb064 (e0986ba5-102c-4272-975e-06c3297cb064): created successfully Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142be3d0-a0e4-4fb5-857f-635d8b74b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:23 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0 Sep 05 04:51:23 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Flow 'volume_create_manager' (509cf5c3-f0bc-47b4-b915-a66fde8eda24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:23 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d4fec799-0c0c-4ced-bc30-cb626b4591dd tempest-ProjectReaderTests-1835023499 None] Created volume successfully. Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Acquiring lock "cinder-e0986ba5-102c-4272-975e-06c3297cb064-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Lock "cinder-e0986ba5-102c-4272-975e-06c3297cb064-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:24 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Acquiring lock "cinder-quobyte-e0986ba5-102c-4272-975e-06c3297cb064" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ffd365a-aad9-4137-b614-ffcbfee65be0" returned: 0 in 0.285s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-quobyte-0ffd365a-aad9-4137-b614-ffcbfee65be0" released by "delete_volume" :: held 0.711s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Lock "cinder-quobyte-e0986ba5-102c-4272-975e-06c3297cb064" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9a684b-16a7-4ebf-a520-607b876732b7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Created reservations ['b7e80545-c30b-4f91-bf09-73a6a78ea7ab', '503d3d01-3336-4da9-8ea3-f83162d29d92', '617956bb-de1c-4a02-a48e-67c9235cc03f', '136461c1-b9ec-4aea-80a0-b2378153f15d'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:24 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064 Sep 05 04:51:24 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:24 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:24 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:24 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.241s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:24 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Deleted volume successfully. Sep 05 04:51:24 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ddabfe3d-4d56-430a-beb7-672004b95c0a tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-0ffd365a-aad9-4137-b614-ffcbfee65be0-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064" returned: 0 in 0.396s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:24 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064 Sep 05 04:51:24 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "cinder-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "cinder-quobyte-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-quobyte-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[848b67f6-1f2d-4c0e-bd2a-97a193662ab5]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:24 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e0986ba5-102c-4272-975e-06c3297cb064" returned: 0 in 0.272s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Lock "cinder-quobyte-e0986ba5-102c-4272-975e-06c3297cb064" released by "delete_volume" :: held 0.710s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:24 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 Sep 05 04:51:24 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:24 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Created reservations ['6f12e2f0-1af6-455f-b474-d890ce37d260', 'edb9e807-1f68-4263-952d-080dabf85682', '8443351a-dd7d-4079-8b92-69be48c12bd1', '09ee3317-10fd-4813-8f58-04e1567e5613'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:25 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:25 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:25 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3" returned: 0 in 0.374s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:25 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3 Sep 05 04:51:25 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:25 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.249s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:25 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Deleted volume successfully. Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-69490e08-b3da-4234-8aa0-e674305f7b2d tempest-ProjectReaderTests-1835023499 None] Lock "cinder-e0986ba5-102c-4272-975e-06c3297cb064-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:25 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3" returned: 0 in 0.265s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-quobyte-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3" released by "delete_volume" :: held 0.682s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Created reservations ['68937799-818b-4900-97f5-180e61e144a7', '5eab45ea-40c8-4f83-93c5-fdf598fce453', '1b5c31da-c2fc-49cc-816d-8912962ae961', 'e62c8d9a-1bfc-43c3-ad6f-7bf945bf84c1'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:25 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:25 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:25 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.249s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:25 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Deleted volume successfully. Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Flow 'volume_create_manager' (b013adcd-6a5d-4ed2-960a-75a40271a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e041fea-7a3c-4382-8001-4c657373d3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-71e83f44-79cc-40f6-8b03-100a0bc58a49 tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-54ed3a58-f6ef-41bc-bb6e-ef354b1beea3-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e041fea-7a3c-4382-8001-4c657373d3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691476255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b1a9f3c-0562-4576-bb25-335538549db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732c00a8865545f5a92c4408904ea55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:26Z,use_quota=True,user_id='f5cd63a798ea4cb7978d5520d72db687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688c3b67-5f0d-43e0-8d32-3a442d3c58a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688c3b67-5f0d-43e0-8d32-3a442d3c58a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e753b3-2121-45b1-9bfe-a37d891066f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e753b3-2121-45b1-9bfe-a37d891066f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b1a9f3c-0562-4576-bb25-335538549db7', 'volume_name': 'volume-8b1a9f3c-0562-4576-bb25-335538549db7', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ab36eb-efb2-4885-9360-e3b58790605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ab36eb-efb2-4885-9360-e3b58790605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7409af-a8fc-4805-8521-1798681d4deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:25 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Volume 8b1a9f3c-0562-4576-bb25-335538549db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b1a9f3c-0562-4576-bb25-335538549db7', 'volume_size': 1} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691476255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b1a9f3c-0562-4576-bb25-335538549db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732c00a8865545f5a92c4408904ea55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:26Z,use_quota=True,user_id='f5cd63a798ea4cb7978d5520d72db687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Creating volume 8b1a9f3c-0562-4576-bb25-335538549db7 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:51:26 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:26 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7 1073741824 Sep 05 04:51:26 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "cinder-55ffd940-d8e8-47cd-9e0e-78904902c384-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-55ffd940-d8e8-47cd-9e0e-78904902c384-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "cinder-quobyte-55ffd940-d8e8-47cd-9e0e-78904902c384" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-quobyte-55ffd940-d8e8-47cd-9e0e-78904902c384" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c2e3e1-939a-4b98-88c3-ed417e0fb252]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:26 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384 Sep 05 04:51:26 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:26 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7 1073741824" returned: 0 in 0.447s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:26 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7 Sep 05 04:51:26 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:26 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384" returned: 0 in 0.384s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:26 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384 Sep 05 04:51:26 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:26 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7409af-a8fc-4805-8521-1798681d4deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b1a9f3c-0562-4576-bb25-335538549db7', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8300ee8-7917-4ee7-9285-a0249e356a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:26 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Volume volume-8b1a9f3c-0562-4576-bb25-335538549db7 (8b1a9f3c-0562-4576-bb25-335538549db7): created successfully Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8300ee8-7917-4ee7-9285-a0249e356a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Flow 'volume_create_manager' (b013adcd-6a5d-4ed2-960a-75a40271a46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:26 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4676fec1-8f10-4653-9291-e215239240e9 tempest-ProjectReaderTests-1835023499 None] Created volume successfully. Sep 05 04:51:26 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-55ffd940-d8e8-47cd-9e0e-78904902c384" returned: 0 in 0.265s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-quobyte-55ffd940-d8e8-47cd-9e0e-78904902c384" released by "delete_volume" :: held 0.686s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Created reservations ['4f04b071-ac7c-4e87-a4bf-f493e03b4752', '2f6240cb-b817-42d9-94d1-3c4ad8cf1e49', 'c974e9ce-5b0b-43ee-8bec-0acb3293a433', '08332988-c312-40b3-96f8-ff6b88f34f7c'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:27 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:27 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:27 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:27 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:27 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Deleted volume successfully. Sep 05 04:51:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d1d7f780-8c64-48c0-b6f4-b716cefa71dd tempest-AttachVolumeNegativeTest-340087041 None] Lock "cinder-55ffd940-d8e8-47cd-9e0e-78904902c384-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Acquiring lock "cinder-8b1a9f3c-0562-4576-bb25-335538549db7-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Lock "cinder-8b1a9f3c-0562-4576-bb25-335538549db7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Acquiring lock "cinder-quobyte-8b1a9f3c-0562-4576-bb25-335538549db7" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Lock "cinder-quobyte-8b1a9f3c-0562-4576-bb25-335538549db7" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:27 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e39e86-35ed-413e-8a5b-9658c4a0e142]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:28 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7 Sep 05 04:51:28 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:28 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7" returned: 0 in 0.370s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:28 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7 Sep 05 04:51:28 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:28 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8b1a9f3c-0562-4576-bb25-335538549db7" returned: 0 in 0.256s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Lock "cinder-quobyte-8b1a9f3c-0562-4576-bb25-335538549db7" released by "delete_volume" :: held 0.687s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Created reservations ['853c9a1a-9dfa-4cee-b602-2cc869c9554b', '94850fa5-ef63-482c-b640-eb337f4cc55e', '4337d9d8-a1e5-4057-980c-d08bb32f533d', '03113bb8-b1f3-45c5-9ed6-ba4a66d0df14'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:28 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:28 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:29 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.263s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Deleted volume successfully. Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-fbc6bec1-0c21-4258-8fd8-0aa45badb888 tempest-ProjectReaderTests-1835023499 None] Lock "cinder-8b1a9f3c-0562-4576-bb25-335538549db7-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Flow 'volume_create_manager' (25299506-5dda-41bb-a4e3-f6ed5a0e416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2f62be-7cd7-4f04-adae-148aea9ca0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2f62be-7cd7-4f04-adae-148aea9ca0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302309295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1407e004-1673-429f-8909-8815d7e4fc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732c00a8865545f5a92c4408904ea55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:29Z,use_quota=True,user_id='f5cd63a798ea4cb7978d5520d72db687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd8c9e5-ae3e-4a3d-a558-26e60f246fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd8c9e5-ae3e-4a3d-a558-26e60f246fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bced7d73-8c69-47bc-a963-d3b2661ddc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bced7d73-8c69-47bc-a963-d3b2661ddc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1407e004-1673-429f-8909-8815d7e4fc1f', 'volume_name': 'volume-1407e004-1673-429f-8909-8815d7e4fc1f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf77521-7365-47a0-9bf5-2ef5dca6c949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf77521-7365-47a0-9bf5-2ef5dca6c949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d738285-af90-480d-8d23-7adf8419c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Volume 1407e004-1673-429f-8909-8815d7e4fc1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1407e004-1673-429f-8909-8815d7e4fc1f', 'volume_size': 1} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302309295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1407e004-1673-429f-8909-8815d7e4fc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732c00a8865545f5a92c4408904ea55a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:29Z,use_quota=True,user_id='f5cd63a798ea4cb7978d5520d72db687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Creating volume 1407e004-1673-429f-8909-8815d7e4fc1f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:51:29 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:51:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:29 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f 1073741824 Sep 05 04:51:29 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:30 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f 1073741824" returned: 0 in 0.429s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:30 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f Sep 05 04:51:30 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:30 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f" returned: 0 in 0.274s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d738285-af90-480d-8d23-7adf8419c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1407e004-1673-429f-8909-8815d7e4fc1f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f5ae4d-28b2-4273-bc29-5a625436dd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Volume volume-1407e004-1673-429f-8909-8815d7e4fc1f (1407e004-1673-429f-8909-8815d7e4fc1f): created successfully Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f5ae4d-28b2-4273-bc29-5a625436dd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Flow 'volume_create_manager' (25299506-5dda-41bb-a4e3-f6ed5a0e416a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-48f4aab0-6a24-46b5-a3fb-fea36979bd37 tempest-ProjectReaderTests-1835023499 None] Created volume successfully. Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Acquiring lock "cinder-1407e004-1673-429f-8909-8815d7e4fc1f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Lock "cinder-1407e004-1673-429f-8909-8815d7e4fc1f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Acquiring lock "cinder-quobyte-1407e004-1673-429f-8909-8815d7e4fc1f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Lock "cinder-quobyte-1407e004-1673-429f-8909-8815d7e4fc1f" acquired by "delete_volume" :: waited 0.013s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d319711f-7f87-4093-8b92-dc2d994bf307]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:30 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f Sep 05 04:51:30 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:30 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f" returned: 0 in 0.356s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:31 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f Sep 05 04:51:31 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:31 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1407e004-1673-429f-8909-8815d7e4fc1f" returned: 0 in 0.300s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Lock "cinder-quobyte-1407e004-1673-429f-8909-8815d7e4fc1f" released by "delete_volume" :: held 0.701s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Created reservations ['c2b57efa-ad6e-4538-ab7e-4d444ed34cf2', '2bc40b95-553c-4fb9-97fe-eb80710ad4ff', 'aaac3d28-e35a-42a3-a012-8afcb7144338', '7da5ee75-b6cc-447c-bbfe-cefc3fe3ed29'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:31 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:31 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:31 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.264s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:31 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Deleted volume successfully. Sep 05 04:51:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e430b101-2633-4656-a0da-a3dd05a292d9 tempest-ProjectReaderTests-1835023499 None] Lock "cinder-1407e004-1673-429f-8909-8815d7e4fc1f-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e1d8cf38-11b3-454b-bbe2-32df241c247e tempest-BackendsCapabilitiesAdminTestsJSON-1186000873 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7087516784668, 'free_capacity_gb': 1773.7087516784668, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89807) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 04:51:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-80d633c5-d710-4216-9f82-fa61cc0bae03 tempest-BackendsCapabilitiesAdminTestsJSON-1186000873 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7087516784668, 'free_capacity_gb': 1773.7087516784668, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89807) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 04:51:41 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=97,cinder:DELETE=8,cinder:SELECT=59,cinder:INSERT=26 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:51:41 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=79,cinder:INSERT=20,cinder:UPDATE=95,cinder:DELETE=7 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Flow 'volume_create_manager' (c2fafe8f-e4f9-4179-8700-340a76fc53e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a692cb-8de8-4298-b82a-23f8f00f7391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a692cb-8de8-4298-b82a-23f8f00f7391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1377241820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e4da5dd8c94ed1a66e72b4a0704275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:52Z,use_quota=True,user_id='ecc7e7d8413046d09b589ba3a9d1c31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d0403c-e4b6-4450-a384-c4acfc023925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d0403c-e4b6-4450-a384-c4acfc023925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0c575a-5500-4ece-b6ed-dc49bdab46c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0c575a-5500-4ece-b6ed-dc49bdab46c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3', 'volume_name': 'volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d45eb34-b363-4a5c-8982-49c09d6d9e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d45eb34-b363-4a5c-8982-49c09d6d9e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4965261-bfe0-4886-b173-941a821269ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:51 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Volume b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3', 'volume_size': 1} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1377241820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e4da5dd8c94ed1a66e72b4a0704275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:51:52Z,use_quota=True,user_id='ecc7e7d8413046d09b589ba3a9d1c31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Creating volume b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:51:51 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:51:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:51 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 1073741824 Sep 05 04:51:51 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:52 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 1073741824" returned: 0 in 0.407s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:52 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 Sep 05 04:51:52 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:52 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3" returned: 0 in 0.248s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4965261-bfe0-4886-b173-941a821269ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28e5d1a7-1d71-4e7c-b9fa-b8be6fd2d3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:52 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Volume volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 (b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3): created successfully Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28e5d1a7-1d71-4e7c-b9fa-b8be6fd2d3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Flow 'volume_create_manager' (c2fafe8f-e4f9-4179-8700-340a76fc53e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-199bf9c6-bd42-4b11-9f34-b3470def21ec tempest-VolumesServicesTestJSON-258234709 None] Created volume successfully. Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Acquiring lock "cinder-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Lock "cinder-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Acquiring lock "cinder-quobyte-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Lock "cinder-quobyte-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3" acquired by "delete_volume" :: waited 0.013s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e52563e-4c04-4f1d-b379-e087c6bf7c03]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:51:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:53 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 Sep 05 04:51:53 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:53 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3" returned: 0 in 0.346s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:53 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3 Sep 05 04:51:53 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:53 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Lock "cinder-quobyte-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3" released by "delete_volume" :: held 0.627s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Created reservations ['c562500a-e419-4b5e-9e70-86f4cfa45456', '79461d27-90a6-4634-89ad-40dcd2a3a750', '593ee9d6-cd61-4d2e-afcc-70cbd2c99aa5', 'dd50db3c-48c8-4048-9ac8-7a10bf809287'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:53 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:51:53 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:51:53 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.240s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:51:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Deleted volume successfully. Sep 05 04:51:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-db647855-42bd-471c-98a5-e06d9e24454e tempest-VolumesServicesTestJSON-258234709 None] Lock "cinder-b688f6ba-a80a-4b84-aeef-22fb0d1d3dc3-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Flow 'volume_create_manager' (0adcf977-bc41-4364-a308-e062475a4f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac65060b-f74d-401c-a4c2-c33d34ad817d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac65060b-f74d-401c-a4c2-c33d34ad817d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-616336112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3829cb23-8348-4225-a807-d7f711c926f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace58a17f02145b0adad09458525b35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:00Z,use_quota=True,user_id='49a2c143229f4ec7af79b237a91bd50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad10d3ab-3d00-4b06-a949-c1dc0cae5ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad10d3ab-3d00-4b06-a949-c1dc0cae5ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e6656a-d59e-4ce3-ac2f-1a427b237e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e6656a-d59e-4ce3-ac2f-1a427b237e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3829cb23-8348-4225-a807-d7f711c926f5', 'volume_name': 'volume-3829cb23-8348-4225-a807-d7f711c926f5', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d27ddd6-7a51-454c-90b5-0264d799333a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d27ddd6-7a51-454c-90b5-0264d799333a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a26ca34-00a3-402c-aa2c-a1b475350552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:51:59 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Volume 3829cb23-8348-4225-a807-d7f711c926f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3829cb23-8348-4225-a807-d7f711c926f5', 'volume_size': 1} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-616336112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3829cb23-8348-4225-a807-d7f711c926f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace58a17f02145b0adad09458525b35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:00Z,use_quota=True,user_id='49a2c143229f4ec7af79b237a91bd50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Creating volume 3829cb23-8348-4225-a807-d7f711c926f5 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:51:59 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:51:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:51:59 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 1073741824 Sep 05 04:51:59 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:00 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 1073741824" returned: 0 in 0.400s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:00 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 Sep 05 04:52:00 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:00 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5" returned: 0 in 0.266s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a26ca34-00a3-402c-aa2c-a1b475350552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3829cb23-8348-4225-a807-d7f711c926f5', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a7228a-bed0-410f-9615-feb0c49029ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:00 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Volume volume-3829cb23-8348-4225-a807-d7f711c926f5 (3829cb23-8348-4225-a807-d7f711c926f5): created successfully Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a7228a-bed0-410f-9615-feb0c49029ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Flow 'volume_create_manager' (0adcf977-bc41-4364-a308-e062475a4f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:00 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8cc444c4-3a44-41d1-9987-09c9d0674f99 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Created volume successfully. Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Creating offline snapshot 0de3c0e9-1110-4645-ad9e-99a0b656b6d7 of volume 3829cb23-8348-4225-a807-d7f711c926f5 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbe2e84-0079-420d-8e25-89fa5a6440b6]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:52:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:00 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 Sep 05 04:52:00 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:01 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5" returned: 0 in 0.356s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:01 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 1G Sep 05 04:52:01 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:01 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 1G" returned: 0 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3829cb23-8348-4225-a807-d7f711c926f5 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:01 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3829cb23-8348-4225-a807-d7f711c926f5 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 Sep 05 04:52:01 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:01 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3829cb23-8348-4225-a807-d7f711c926f5 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7" returned: 0 in 0.296s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:01 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 is being set with open permissions: ugo+rw Sep 05 04:52:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:01 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 Sep 05 04:52:01 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:02 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7" returned: 0 in 0.243s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:02 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.info Sep 05 04:52:02 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:02 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.info" returned: 0 in 0.256s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:02 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.info is being set with open permissions: ugo+rw Sep 05 04:52:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:02 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.info Sep 05 04:52:02 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:02 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.info" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:02 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5e00f410-8119-4db2-a692-d11687154810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Create snapshot completed successfully Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Acquiring lock "cinder-0de3c0e9-1110-4645-ad9e-99a0b656b6d7-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "cinder-0de3c0e9-1110-4645-ad9e-99a0b656b6d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Acquiring lock "cinder-quobyte-3829cb23-8348-4225-a807-d7f711c926f5" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "cinder-quobyte-3829cb23-8348-4225-a807-d7f711c926f5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Acquiring lock "cinder-quobyte-0de3c0e9-1110-4645-ad9e-99a0b656b6d7" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "cinder-quobyte-0de3c0e9-1110-4645-ad9e-99a0b656b6d7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Deleting offline snapshot 0de3c0e9-1110-4645-ad9e-99a0b656b6d7 of volume 3829cb23-8348-4225-a807-d7f711c926f5 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] snapshot_file for this snap is: volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ded3ce-ffd6-480b-80ad-ee7269114314]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:03 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 Sep 05 04:52:03 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:03 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7" returned: 0 in 0.365s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3829cb23-8348-4225-a807-d7f711c926f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b47ff7-032c-40cb-bab4-9bd5a51c567e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:52:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:03 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 Sep 05 04:52:03 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:04 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5" returned: 0 in 0.349s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:04 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 Sep 05 04:52:04 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:04 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7" returned: 0 in 0.327s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:04 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7 Sep 05 04:52:04 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:04 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5.0de3c0e9-1110-4645-ad9e-99a0b656b6d7" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "cinder-quobyte-0de3c0e9-1110-4645-ad9e-99a0b656b6d7" released by "_delete_snapshot" :: held 1.400s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "cinder-quobyte-3829cb23-8348-4225-a807-d7f711c926f5" released by "delete_snapshot" :: held 1.423s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:04 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Created reservations ['1766f92c-7025-4ec8-8e54-f26e6e05c5cd', 'e11fa21d-1ac5-4414-9c7e-b884e658299f', 'd789b343-07af-49fd-8bda-048383df2255', 'a9e981b2-cc2e-47fd-9159-969757622f50'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:52:04 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Delete snapshot completed successfully. Sep 05 04:52:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c9dd7b91-0175-4eb5-a4ea-4a2b606ad5d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "cinder-0de3c0e9-1110-4645-ad9e-99a0b656b6d7-delete_snapshot" released by "delete_snapshot" :: held 1.550s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Acquiring lock "cinder-3829cb23-8348-4225-a807-d7f711c926f5-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "cinder-3829cb23-8348-4225-a807-d7f711c926f5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Acquiring lock "cinder-quobyte-3829cb23-8348-4225-a807-d7f711c926f5" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "cinder-quobyte-3829cb23-8348-4225-a807-d7f711c926f5" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:05 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d24aa9-12ea-44e2-bc9f-398912388a69]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:52:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:05 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 Sep 05 04:52:05 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:05 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5" returned: 0 in 0.356s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:05 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5 Sep 05 04:52:05 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:06 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3829cb23-8348-4225-a807-d7f711c926f5" returned: 0 in 0.241s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "cinder-quobyte-3829cb23-8348-4225-a807-d7f711c926f5" released by "delete_volume" :: held 0.650s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Created reservations ['e1243a69-0e3e-4487-a1f2-1d822803d420', '873354e7-6470-4784-94de-0b018dae5f6c', '3d460cac-f67b-4289-a1d8-b892c0871a1c', '10b468b3-18b7-4ad3-88ef-cc94ff8f40ed'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:06 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:52:06 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:06 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:52:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Deleted volume successfully. Sep 05 04:52:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f60362e9-cfd5-4c2d-803e-92a55c165aad tempest-VolumeSnapshotQuotasNegativeTestJSON-1982887555 None] Lock "cinder-3829cb23-8348-4225-a807-d7f711c926f5-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:10 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:52:10 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:10 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:52:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:52:24 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=25,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:52:24 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=22,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=4 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Flow 'volume_create_manager' (ddbc4169-e0df-4607-a5c1-0556ce156e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21e38af-baad-4061-a865-2cd1a07d7d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21e38af-baad-4061-a865-2cd1a07d7d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1192964706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ad8aa9-c3de-4a8a-8a0d-50badb8d278f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4d231d9ede4fcbb1f1e5ff989c5b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:28Z,use_quota=True,user_id='18a4431607fa4a86a8868712da421492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408d5c64-01e7-4d1e-aeb8-c5755eaad42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408d5c64-01e7-4d1e-aeb8-c5755eaad42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7bd138-6bcc-4d91-b854-6cf7b2dbe08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7bd138-6bcc-4d91-b854-6cf7b2dbe08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06ad8aa9-c3de-4a8a-8a0d-50badb8d278f', 'volume_name': 'volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7547320e-dedf-4811-af95-24d3174679e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7547320e-dedf-4811-af95-24d3174679e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad241db-86e7-495f-a5d5-52265229c62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:28 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Volume 06ad8aa9-c3de-4a8a-8a0d-50badb8d278f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f', 'volume_size': 1} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1192964706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ad8aa9-c3de-4a8a-8a0d-50badb8d278f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4d231d9ede4fcbb1f1e5ff989c5b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:28Z,use_quota=True,user_id='18a4431607fa4a86a8868712da421492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Creating volume 06ad8aa9-c3de-4a8a-8a0d-50badb8d278f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:52:28 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:28 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f 1073741824 Sep 05 04:52:28 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:28 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f 1073741824" returned: 0 in 0.408s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:29 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f Sep 05 04:52:29 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:29 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f" returned: 0 in 0.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:52:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad241db-86e7-495f-a5d5-52265229c62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d809d3f3-bfe5-4b9b-b9fe-bc2c24c7f0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Volume volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f (06ad8aa9-c3de-4a8a-8a0d-50badb8d278f): created successfully Sep 05 04:52:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d809d3f3-bfe5-4b9b-b9fe-bc2c24c7f0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Flow 'volume_create_manager' (ddbc4169-e0df-4607-a5c1-0556ce156e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1af73645-62ce-4104-a5bc-f62a4b1c1f2e tempest-VolumesListAdminTestJSON-1538912801 None] Created volume successfully. Sep 05 04:52:29 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Flow 'volume_create_manager' (e220328f-054e-435b-a611-b32037ec3fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a531ddc-a5a0-4e2c-8720-9aad15a645e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a531ddc-a5a0-4e2c-8720-9aad15a645e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2107614257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41eba54-59a2-4733-9807-f7706f0dce3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4d231d9ede4fcbb1f1e5ff989c5b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:30Z,use_quota=True,user_id='18a4431607fa4a86a8868712da421492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b185eb0-b8c2-443d-98a6-0baa5e8d2c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b185eb0-b8c2-443d-98a6-0baa5e8d2c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef1899-2eb7-4d42-92ce-fce3af4f22f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef1899-2eb7-4d42-92ce-fce3af4f22f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41eba54-59a2-4733-9807-f7706f0dce3e', 'volume_name': 'volume-a41eba54-59a2-4733-9807-f7706f0dce3e', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38460140-3a18-4ad9-963a-74bfd93663e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38460140-3a18-4ad9-963a-74bfd93663e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557e320b-1963-4eec-9e3f-46c92532b505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Volume a41eba54-59a2-4733-9807-f7706f0dce3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41eba54-59a2-4733-9807-f7706f0dce3e', 'volume_size': 1} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2107614257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41eba54-59a2-4733-9807-f7706f0dce3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4d231d9ede4fcbb1f1e5ff989c5b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:30Z,use_quota=True,user_id='18a4431607fa4a86a8868712da421492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Creating volume a41eba54-59a2-4733-9807-f7706f0dce3e {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:52:30 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:30 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e 1073741824 Sep 05 04:52:30 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:30 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e 1073741824" returned: 0 in 0.410s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:30 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e Sep 05 04:52:30 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:30 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e" returned: 0 in 0.257s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557e320b-1963-4eec-9e3f-46c92532b505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41eba54-59a2-4733-9807-f7706f0dce3e', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895c8fb9-9760-4b5a-aed3-826f43424905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Volume volume-a41eba54-59a2-4733-9807-f7706f0dce3e (a41eba54-59a2-4733-9807-f7706f0dce3e): created successfully Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895c8fb9-9760-4b5a-aed3-826f43424905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Flow 'volume_create_manager' (e220328f-054e-435b-a611-b32037ec3fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d4081464-6cbd-436e-b465-0a218a2e35ae tempest-VolumesListAdminTestJSON-1538912801 None] Created volume successfully. Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Flow 'volume_create_manager' (f7fbcd8e-af52-4d64-ad8b-4f8541d52623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5fc6b96-cc96-45a4-bd13-04d907b81381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5fc6b96-cc96-45a4-bd13-04d907b81381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-10460459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d319049b-cd7a-401f-985a-342b1f8a6eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4d231d9ede4fcbb1f1e5ff989c5b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:31Z,use_quota=True,user_id='18a4431607fa4a86a8868712da421492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990f67d6-cd28-413b-bb04-4d794b103982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990f67d6-cd28-413b-bb04-4d794b103982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb59cec-6b79-40b5-aa0d-8df70d99ef3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb59cec-6b79-40b5-aa0d-8df70d99ef3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd319049b-cd7a-401f-985a-342b1f8a6eb6', 'volume_name': 'volume-d319049b-cd7a-401f-985a-342b1f8a6eb6', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad27b3d-f1bf-4ccf-9fb1-eb0d7d76ac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad27b3d-f1bf-4ccf-9fb1-eb0d7d76ac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8994a7ef-f48f-4a5f-ae45-c2413c8f0dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:31 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Volume d319049b-cd7a-401f-985a-342b1f8a6eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d319049b-cd7a-401f-985a-342b1f8a6eb6', 'volume_size': 1} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-10460459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d319049b-cd7a-401f-985a-342b1f8a6eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4d231d9ede4fcbb1f1e5ff989c5b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:31Z,use_quota=True,user_id='18a4431607fa4a86a8868712da421492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Creating volume d319049b-cd7a-401f-985a-342b1f8a6eb6 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:52:31 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:31 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6 1073741824 Sep 05 04:52:31 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:31 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6 1073741824" returned: 0 in 0.399s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:32 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6 Sep 05 04:52:32 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:32 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6" returned: 0 in 0.243s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:52:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8994a7ef-f48f-4a5f-ae45-c2413c8f0dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d319049b-cd7a-401f-985a-342b1f8a6eb6', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528c36d0-b616-47c0-955a-e943b85e296c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:32 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Volume volume-d319049b-cd7a-401f-985a-342b1f8a6eb6 (d319049b-cd7a-401f-985a-342b1f8a6eb6): created successfully Sep 05 04:52:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528c36d0-b616-47c0-955a-e943b85e296c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Flow 'volume_create_manager' (f7fbcd8e-af52-4d64-ad8b-4f8541d52623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f84bed30-24cb-4e3b-80e0-c4a750be6d06 tempest-VolumesListAdminTestJSON-1538912801 None] Created volume successfully. Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Flow 'volume_create_manager' (bcd9e51d-bc3c-49bb-8d0f-80ca0146f404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ba79db-b8ba-4336-a390-d971d6abdddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ba79db-b8ba-4336-a390-d971d6abdddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5a40f0-0716-437b-b358-4a0a1a670b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b42c54092ac4a3a8b4e01034cee2483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:33Z,use_quota=True,user_id='7368af056c5449f3b22d438f93f592b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3e3bd6-aa3e-46ab-950f-33bf70d59675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3e3bd6-aa3e-46ab-950f-33bf70d59675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ff3971-ff46-4f44-b73d-d1ebda6c45a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ff3971-ff46-4f44-b73d-d1ebda6c45a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5a40f0-0716-437b-b358-4a0a1a670b66', 'volume_name': 'volume-6c5a40f0-0716-437b-b358-4a0a1a670b66', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a14fd31-ff1e-43e5-b0dd-a2124e6df78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a14fd31-ff1e-43e5-b0dd-a2124e6df78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd4e617-5cad-44a1-b074-2fdf119345d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:33 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Volume 6c5a40f0-0716-437b-b358-4a0a1a670b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5a40f0-0716-437b-b358-4a0a1a670b66', 'volume_size': 1} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5a40f0-0716-437b-b358-4a0a1a670b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b42c54092ac4a3a8b4e01034cee2483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:33Z,use_quota=True,user_id='7368af056c5449f3b22d438f93f592b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Creating volume 6c5a40f0-0716-437b-b358-4a0a1a670b66 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:52:33 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:33 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66 1073741824 Sep 05 04:52:33 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:33 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66 1073741824" returned: 0 in 0.407s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:33 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66 Sep 05 04:52:33 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:33 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd4e617-5cad-44a1-b074-2fdf119345d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5a40f0-0716-437b-b358-4a0a1a670b66', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc80c5b7-1a13-45b3-8b54-30c7cfdbf93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:33 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Volume volume-6c5a40f0-0716-437b-b358-4a0a1a670b66 (6c5a40f0-0716-437b-b358-4a0a1a670b66): created successfully Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc80c5b7-1a13-45b3-8b54-30c7cfdbf93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Flow 'volume_create_manager' (bcd9e51d-bc3c-49bb-8d0f-80ca0146f404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:33 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-38a8af45-43a1-4d41-8dce-d6cc0d642a0a tempest-VolumesListAdminTestJSON-1161790235 None] Created volume successfully. Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Acquiring lock "cinder-6c5a40f0-0716-437b-b358-4a0a1a670b66-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Lock "cinder-6c5a40f0-0716-437b-b358-4a0a1a670b66-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Acquiring lock "cinder-quobyte-6c5a40f0-0716-437b-b358-4a0a1a670b66" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Lock "cinder-quobyte-6c5a40f0-0716-437b-b358-4a0a1a670b66" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2837e5-75fd-4731-b645-87bd6e23bd32]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "cinder-d319049b-cd7a-401f-985a-342b1f8a6eb6-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-d319049b-cd7a-401f-985a-342b1f8a6eb6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "cinder-quobyte-d319049b-cd7a-401f-985a-342b1f8a6eb6" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-quobyte-d319049b-cd7a-401f-985a-342b1f8a6eb6" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:34 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66 Sep 05 04:52:34 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c1fb48-384c-410e-9157-0b0fd251fa0b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:34 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6 Sep 05 04:52:34 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:34 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66" returned: 0 in 0.398s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:34 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66 Sep 05 04:52:34 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:34 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6" returned: 0 in 0.370s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:34 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6 Sep 05 04:52:34 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:35 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c5a40f0-0716-437b-b358-4a0a1a670b66" returned: 0 in 0.251s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Lock "cinder-quobyte-6c5a40f0-0716-437b-b358-4a0a1a670b66" released by "delete_volume" :: held 0.693s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Created reservations ['91f31352-c606-4f5b-a4e6-01f6e135bfca', 'a31fba89-bf9c-4069-8fed-cbb1f2a5dcbb', '07a6b342-411d-4dc0-93e5-f1b3d48b2dea', '7601ca3f-9e7b-4e30-afe6-26dccf6649ac'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:35 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d319049b-cd7a-401f-985a-342b1f8a6eb6" returned: 0 in 0.274s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-quobyte-d319049b-cd7a-401f-985a-342b1f8a6eb6" released by "delete_volume" :: held 0.692s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:35 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:52:35 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Created reservations ['1ef8541f-d2fd-4542-ac01-cece44dc1e98', '3b21cab4-2e3c-4d07-a2b9-1f0ae53196ce', '108ef9ee-fa7f-4d20-a624-64dc93def174', '53210fd7-17fd-405c-819d-7e9b6f50961d'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:35 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:52:35 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:35 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.261s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:52:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Deleted volume successfully. Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e7a9ac76-def5-475a-ae98-23aafd1e170d tempest-VolumesListAdminTestJSON-1161790235 None] Lock "cinder-6c5a40f0-0716-437b-b358-4a0a1a670b66-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:35 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:52:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Deleted volume successfully. Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e4ade621-73a3-4bbe-8afb-dae3e62d35aa tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-d319049b-cd7a-401f-985a-342b1f8a6eb6-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "cinder-a41eba54-59a2-4733-9807-f7706f0dce3e-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-a41eba54-59a2-4733-9807-f7706f0dce3e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "cinder-quobyte-a41eba54-59a2-4733-9807-f7706f0dce3e" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-quobyte-a41eba54-59a2-4733-9807-f7706f0dce3e" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdcdf90-380f-443b-8a6d-0f628a1247b7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:52:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:35 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e Sep 05 04:52:35 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:36 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e" returned: 0 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:36 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e Sep 05 04:52:36 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:36 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-a41eba54-59a2-4733-9807-f7706f0dce3e" returned: 0 in 0.247s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-quobyte-a41eba54-59a2-4733-9807-f7706f0dce3e" released by "delete_volume" :: held 0.651s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Created reservations ['e62fdb02-391a-4a59-9ee4-99aeba9f4367', 'ec8a0b82-2215-4473-bcff-bd582a79938e', 'a720a455-1c97-4945-8f8c-c3c10a5591bb', 'cf05de7d-df31-4c73-9ae7-167501bbc3c0'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:36 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:52:36 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:36 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.242s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:52:36 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Deleted volume successfully. Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-677e0dab-cdac-48ef-9088-d5e2a7e1d299 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-a41eba54-59a2-4733-9807-f7706f0dce3e-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "cinder-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "cinder-quobyte-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-quobyte-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f" acquired by "delete_volume" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[38de7090-2cd5-4cf8-a76c-ee7ae62d2dfd]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:52:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:37 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f Sep 05 04:52:37 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:37 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f" returned: 0 in 0.353s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:37 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f Sep 05 04:52:37 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:37 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f" returned: 0 in 0.240s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-quobyte-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f" released by "delete_volume" :: held 0.629s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Created reservations ['cc882d6f-b00f-42cd-a241-d4f2f9c710a5', '430d1f22-4606-4b30-a757-2ffc0c1f4f11', '4c2acc7d-a155-4077-96c2-c8cb33613c5e', 'c1256ec8-05c6-4c8f-98c0-1af560578808'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:37 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:52:37 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:37 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.240s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:52:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Deleted volume successfully. Sep 05 04:52:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5b522e5d-4f9c-49a3-ac34-0400e72453b6 tempest-VolumesListAdminTestJSON-1538912801 None] Lock "cinder-06ad8aa9-c3de-4a8a-8a0d-50badb8d278f-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Flow 'volume_create_manager' (bebc7231-babb-4e0b-987d-a65779497638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6be3b3-9019-47ec-b6ad-228a92e07d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6be3b3-9019-47ec-b6ad-228a92e07d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-488746456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ccfad69-2b4c-4ca1-9480-b087dc625652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62c12f718f34a94a2e60b4119fd843b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:45Z,use_quota=True,user_id='4ff09c7c5aed4d4a871be58c9d0e5c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4adb43e-876d-4a6b-b327-6d1507931ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4adb43e-876d-4a6b-b327-6d1507931ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadca514-eecf-40d2-a046-1e4f1dc81458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadca514-eecf-40d2-a046-1e4f1dc81458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ccfad69-2b4c-4ca1-9480-b087dc625652', 'volume_name': 'volume-3ccfad69-2b4c-4ca1-9480-b087dc625652', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46cdff50-ad32-493e-9090-238af16247ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46cdff50-ad32-493e-9090-238af16247ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca12818-7e47-4f34-881e-78e6df2eddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:45 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Volume 3ccfad69-2b4c-4ca1-9480-b087dc625652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ccfad69-2b4c-4ca1-9480-b087dc625652', 'volume_size': 1} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-488746456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ccfad69-2b4c-4ca1-9480-b087dc625652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62c12f718f34a94a2e60b4119fd843b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:45Z,use_quota=True,user_id='4ff09c7c5aed4d4a871be58c9d0e5c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Creating volume 3ccfad69-2b4c-4ca1-9480-b087dc625652 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:52:45 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:45 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652 1073741824 Sep 05 04:52:45 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:45 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652 1073741824" returned: 0 in 0.428s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:45 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652 Sep 05 04:52:45 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:45 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652" returned: 0 in 0.256s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca12818-7e47-4f34-881e-78e6df2eddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ccfad69-2b4c-4ca1-9480-b087dc625652', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fe856a-a1c7-448b-9bf8-160be7ab830c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:45 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Volume volume-3ccfad69-2b4c-4ca1-9480-b087dc625652 (3ccfad69-2b4c-4ca1-9480-b087dc625652): created successfully Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fe856a-a1c7-448b-9bf8-160be7ab830c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Flow 'volume_create_manager' (bebc7231-babb-4e0b-987d-a65779497638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-70b1a498-0462-4ffa-a45f-09d8eeb00cd5 tempest-VolumesMetadataTest-910006341 None] Created volume successfully. Sep 05 04:52:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Acquiring lock "cinder-3ccfad69-2b4c-4ca1-9480-b087dc625652-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Lock "cinder-3ccfad69-2b4c-4ca1-9480-b087dc625652-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Acquiring lock "cinder-quobyte-3ccfad69-2b4c-4ca1-9480-b087dc625652" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Lock "cinder-quobyte-3ccfad69-2b4c-4ca1-9480-b087dc625652" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:46 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e10004-f951-4dca-86de-981afb84147e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:52:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:47 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652 Sep 05 04:52:47 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:47 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652" returned: 0 in 0.364s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:47 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652 Sep 05 04:52:47 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:47 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ccfad69-2b4c-4ca1-9480-b087dc625652" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Lock "cinder-quobyte-3ccfad69-2b4c-4ca1-9480-b087dc625652" released by "delete_volume" :: held 0.657s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Created reservations ['55a8d908-edbd-4ef7-81b6-259e84ff314c', 'ce646d91-2f08-4665-be1d-3e9cd1f28b86', 'd92bd2a5-3e32-4a4a-9af0-2c26eff43666', 'cb1cb43e-4d0f-4834-8262-901ceeba6bfd'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:47 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:52:47 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:47 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.252s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:52:47 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Deleted volume successfully. Sep 05 04:52:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f3270a6c-9bf8-420e-b998-9c6e619e85ce tempest-VolumesMetadataTest-910006341 None] Lock "cinder-3ccfad69-2b4c-4ca1-9480-b087dc625652-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Flow 'volume_create_manager' (378eceed-d6f7-4623-97ba-658e34147bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2390b3-7422-4c1f-b3ec-5d80e0b2eff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2390b3-7422-4c1f-b3ec-5d80e0b2eff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1849082408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bddc58d-df15-44c3-8e4f-e568e9b189bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aedbd086cbb944a98f752e14b64ff573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:51Z,use_quota=True,user_id='5327dd34bc8c49aca93fbae0ef258588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e18b0c3-b20c-480b-acdf-fbc31e01f954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e18b0c3-b20c-480b-acdf-fbc31e01f954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0707773c-1699-4527-882e-9a55cabf971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0707773c-1699-4527-882e-9a55cabf971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bddc58d-df15-44c3-8e4f-e568e9b189bb', 'volume_name': 'volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb', 'volume_size': 2}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ad2746-9f6a-467a-a241-4a2f88bc5654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ad2746-9f6a-467a-a241-4a2f88bc5654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e394945b-6293-49f2-9ffb-2526a234514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:51 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Volume 8bddc58d-df15-44c3-8e4f-e568e9b189bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb', 'volume_size': 2} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1849082408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bddc58d-df15-44c3-8e4f-e568e9b189bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aedbd086cbb944a98f752e14b64ff573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:52:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:52:51Z,use_quota=True,user_id='5327dd34bc8c49aca93fbae0ef258588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Creating volume 8bddc58d-df15-44c3-8e4f-e568e9b189bb {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:52:51 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb 2147483648 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:51 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb 2147483648 Sep 05 04:52:51 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:51 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb 2147483648" returned: 0 in 0.450s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:51 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb Sep 05 04:52:51 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:52 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e394945b-6293-49f2-9ffb-2526a234514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb', 'volume_size': 2}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8650d3-16d3-4005-811f-e262f932f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:52:52 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Volume volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb (8bddc58d-df15-44c3-8e4f-e568e9b189bb): created successfully Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8650d3-16d3-4005-811f-e262f932f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Flow 'volume_create_manager' (378eceed-d6f7-4623-97ba-658e34147bd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:52:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c11b1f1b-a3c5-4dfc-be7f-8a644d29ec77 tempest-VolumesCloneNegativeTest-1573188131 None] Created volume successfully. Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Acquiring lock "cinder-8bddc58d-df15-44c3-8e4f-e568e9b189bb-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Lock "cinder-8bddc58d-df15-44c3-8e4f-e568e9b189bb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Acquiring lock "cinder-quobyte-8bddc58d-df15-44c3-8e4f-e568e9b189bb" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Lock "cinder-quobyte-8bddc58d-df15-44c3-8e4f-e568e9b189bb" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7ab566-05bf-45cc-bc2b-5eb3de0c594b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:52 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb Sep 05 04:52:52 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:52 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb" returned: 0 in 0.361s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:52 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb Sep 05 04:52:52 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:53 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8bddc58d-df15-44c3-8e4f-e568e9b189bb" returned: 0 in 0.240s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Lock "cinder-quobyte-8bddc58d-df15-44c3-8e4f-e568e9b189bb" released by "delete_volume" :: held 0.636s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Created reservations ['cb795133-0b34-426b-b6f4-68a41c123980', 'caa9c818-2d58-4bd9-a3e6-9a659c601c0e', 'ef6c2061-6949-4b09-827b-93ea96f72241', 'c3ce7ed1-fafd-4f14-ace5-a14e3051c1e3'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:52:53 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:52:53 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:52:53 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.238s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:52:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Deleted volume successfully. Sep 05 04:52:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d8a3750a-e143-4182-a315-d271af9030b4 tempest-VolumesCloneNegativeTest-1573188131 None] Lock "cinder-8bddc58d-df15-44c3-8e4f-e568e9b189bb-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:03 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=68,cinder:INSERT=14,cinder:SELECT=44,cinder:DELETE=4 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:53:03 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=40,cinder:UPDATE=64,cinder:DELETE=8,cinder:INSERT=16 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Flow 'volume_create_manager' (78c27029-90b9-4164-8fc0-1c9b7d0e88d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a5fb61-b4e5-4138-a718-c3ffd9fc7cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a5fb61-b4e5-4138-a718-c3ffd9fc7cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1070278076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed2991b-e078-4b23-97a2-4a3d1cf986fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74627af736874fff8fd8022b691bfdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:53:06Z,use_quota=True,user_id='43a1e273749240ea8b311984f1c99e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f639f15e-8ce8-401a-9b7f-f51702505645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f639f15e-8ce8-401a-9b7f-f51702505645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc1029d-5226-4be8-9175-61a69229fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc1029d-5226-4be8-9175-61a69229fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed2991b-e078-4b23-97a2-4a3d1cf986fa', 'volume_name': 'volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5706c28f-5a99-4c1a-80c8-4e83dc8a1a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5706c28f-5a99-4c1a-80c8-4e83dc8a1a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8627ed-da52-490c-a160-398cc4ef149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:05 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Volume bed2991b-e078-4b23-97a2-4a3d1cf986fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa', 'volume_size': 1} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1070278076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed2991b-e078-4b23-97a2-4a3d1cf986fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74627af736874fff8fd8022b691bfdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:53:06Z,use_quota=True,user_id='43a1e273749240ea8b311984f1c99e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Creating volume bed2991b-e078-4b23-97a2-4a3d1cf986fa {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:53:05 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:53:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:05 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa 1073741824 Sep 05 04:53:05 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:06 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa 1073741824" returned: 0 in 0.405s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:06 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa Sep 05 04:53:06 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:06 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa" returned: 0 in 0.243s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8627ed-da52-490c-a160-398cc4ef149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82af3f73-2127-446b-8ae1-a0c1e966ae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:06 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Volume volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa (bed2991b-e078-4b23-97a2-4a3d1cf986fa): created successfully Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82af3f73-2127-446b-8ae1-a0c1e966ae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Flow 'volume_create_manager' (78c27029-90b9-4164-8fc0-1c9b7d0e88d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:53:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8db65550-59d6-4f10-a22a-b82b0793fee0 tempest-VolumesSnapshotTestJSON-1885129 None] Created volume successfully. Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Creating offline snapshot 0a6c46ea-a075-4a11-9db3-d43ac6549be3 of volume bed2991b-e078-4b23-97a2-4a3d1cf986fa {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:53:07 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[06896a90-e20e-4c73-b80f-aca01d51c8ad]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:07 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa Sep 05 04:53:07 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:07 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa" returned: 0 in 0.346s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:07 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 1G Sep 05 04:53:07 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:07 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 1G" returned: 0 in 0.385s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:07 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 Sep 05 04:53:07 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:08 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3" returned: 0 in 0.314s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:08 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 is being set with open permissions: ugo+rw Sep 05 04:53:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:08 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 Sep 05 04:53:08 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:08 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3" returned: 0 in 0.244s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:08 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.info Sep 05 04:53:08 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:08 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.info" returned: 0 in 0.244s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:08 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.info is being set with open permissions: ugo+rw Sep 05 04:53:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:08 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.info Sep 05 04:53:08 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:08 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.info" returned: 0 in 0.238s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:08 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-cfa6d60f-272f-41a1-9a03-3c778c183f68 tempest-VolumesSnapshotTestJSON-1885129 None] Create snapshot completed successfully Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-0a6c46ea-a075-4a11-9db3-d43ac6549be3-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-0a6c46ea-a075-4a11-9db3-d43ac6549be3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-bed2991b-e078-4b23-97a2-4a3d1cf986fa" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-bed2991b-e078-4b23-97a2-4a3d1cf986fa" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-0a6c46ea-a075-4a11-9db3-d43ac6549be3" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-0a6c46ea-a075-4a11-9db3-d43ac6549be3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Deleting offline snapshot 0a6c46ea-a075-4a11-9db3-d43ac6549be3 of volume bed2991b-e078-4b23-97a2-4a3d1cf986fa {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] snapshot_file for this snap is: volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a807f45-3255-4c80-a737-11761de886a0]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:09 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 Sep 05 04:53:09 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:09 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3" returned: 0 in 0.350s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[881eadb1-958f-4b0c-a4ab-dc1ae0ca7241]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:09 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa Sep 05 04:53:09 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:10 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa" returned: 0 in 0.349s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:10 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 Sep 05 04:53:10 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:10 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3" returned: 0 in 0.325s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:10 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3 Sep 05 04:53:10 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:10 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa.0a6c46ea-a075-4a11-9db3-d43ac6549be3" returned: 0 in 0.239s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-0a6c46ea-a075-4a11-9db3-d43ac6549be3" released by "_delete_snapshot" :: held 1.357s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-bed2991b-e078-4b23-97a2-4a3d1cf986fa" released by "delete_snapshot" :: held 1.377s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:10 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:53:10 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Created reservations ['46a460cf-f8ba-45a6-8a39-d43e51651f08', 'da8677ef-0969-4aec-bf82-378f0bce67ef', '52ceb3cd-61c0-4357-8b2c-b47bb25132c3', '9f43fce5-2f6f-4ef9-9317-7ad3d9385314'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:53:10 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Delete snapshot completed successfully. Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e9f0ddfe-48de-4086-85f1-47511d37f524 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-0a6c46ea-a075-4a11-9db3-d43ac6549be3-delete_snapshot" released by "delete_snapshot" :: held 1.566s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:10 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:53:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Flow 'volume_create_manager' (8c06fca0-a999-4140-8c2a-97b91433bb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f0daac-29f5-4e60-8038-3970a3609dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f0daac-29f5-4e60-8038-3970a3609dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2035781985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35610908-ed1a-480b-9b2f-d6fcc4eca607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74627af736874fff8fd8022b691bfdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:53:12Z,use_quota=True,user_id='43a1e273749240ea8b311984f1c99e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412f1da0-d387-4f10-9741-fe50d627e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412f1da0-d387-4f10-9741-fe50d627e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d308a448-5233-4d47-aa1a-5206b94ecd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d308a448-5233-4d47-aa1a-5206b94ecd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35610908-ed1a-480b-9b2f-d6fcc4eca607', 'volume_name': 'volume-35610908-ed1a-480b-9b2f-d6fcc4eca607', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46c19b3-df8b-47fb-86b3-324b20e9202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46c19b3-df8b-47fb-86b3-324b20e9202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ced462-bd28-4763-9fe0-1b27f0dc84c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:11 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Volume 35610908-ed1a-480b-9b2f-d6fcc4eca607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35610908-ed1a-480b-9b2f-d6fcc4eca607', 'volume_size': 1} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2035781985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35610908-ed1a-480b-9b2f-d6fcc4eca607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74627af736874fff8fd8022b691bfdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:53:12Z,use_quota=True,user_id='43a1e273749240ea8b311984f1c99e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Creating volume 35610908-ed1a-480b-9b2f-d6fcc4eca607 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:53:11 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:53:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:11 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 1073741824 Sep 05 04:53:11 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:12 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 1073741824" returned: 0 in 0.392s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:12 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 Sep 05 04:53:12 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:12 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607" returned: 0 in 0.238s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ced462-bd28-4763-9fe0-1b27f0dc84c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35610908-ed1a-480b-9b2f-d6fcc4eca607', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8c956d-5970-4990-8edb-71b924346522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:12 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Volume volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 (35610908-ed1a-480b-9b2f-d6fcc4eca607): created successfully Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8c956d-5970-4990-8edb-71b924346522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Flow 'volume_create_manager' (8c06fca0-a999-4140-8c2a-97b91433bb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:53:12 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-775d49a8-4b7c-4df5-b2da-3309f432e43a tempest-VolumesSnapshotTestJSON-1885129 None] Created volume successfully. Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:13 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Creating offline snapshot dc2795bd-45b6-4335-8ff3-8a442eea7d90 of volume 35610908-ed1a-480b-9b2f-d6fcc4eca607 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:53:13 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f958ab-98f4-4428-9cdc-8b89c80acabc]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:13 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 Sep 05 04:53:13 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:13 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607" returned: 0 in 0.352s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:13 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 1G Sep 05 04:53:13 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:13 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 1G" returned: 0 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:13 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 Sep 05 04:53:13 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:14 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90" returned: 0 in 0.291s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:14 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 is being set with open permissions: ugo+rw Sep 05 04:53:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:14 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 Sep 05 04:53:14 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:14 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90" returned: 0 in 0.242s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:14 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.info Sep 05 04:53:14 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:14 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.info" returned: 0 in 0.248s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:14 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.info is being set with open permissions: ugo+rw Sep 05 04:53:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:14 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.info Sep 05 04:53:14 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:14 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.info" returned: 0 in 0.234s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:14 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3d80f69d-3fb8-470a-9c37-35febfe22487 tempest-VolumesSnapshotTestJSON-1885129 None] Create snapshot completed successfully Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Flow 'volume_create_manager' (093863d7-2a67-4f29-a71d-5df51f8f40f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717039e2-e0dc-454f-a21c-343f4e265abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717039e2-e0dc-454f-a21c-343f4e265abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1140754917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c17f803-ce20-4613-9962-18f80b12cb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74627af736874fff8fd8022b691bfdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:53:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dc2795bd-45b6-4335-8ff3-8a442eea7d90,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:53:16Z,use_quota=True,user_id='43a1e273749240ea8b311984f1c99e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef05ef9-e115-4704-9ae8-bf2a07485b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef05ef9-e115-4704-9ae8-bf2a07485b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1966e50-3410-49d0-94e7-2a63ce849e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1966e50-3410-49d0-94e7-2a63ce849e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c17f803-ce20-4613-9962-18f80b12cb83', 'volume_name': 'volume-6c17f803-ce20-4613-9962-18f80b12cb83', 'volume_size': 2, 'snapshot_id': 'dc2795bd-45b6-4335-8ff3-8a442eea7d90'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431cf48e-b71d-493d-8e0f-d4a546b10e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431cf48e-b71d-493d-8e0f-d4a546b10e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7c885e-c2f2-4afa-9e66-40f089d1476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:15 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Volume 6c17f803-ce20-4613-9962-18f80b12cb83: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c17f803-ce20-4613-9962-18f80b12cb83', 'volume_size': 2, 'snapshot_id': 'dc2795bd-45b6-4335-8ff3-8a442eea7d90'} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-dc2795bd-45b6-4335-8ff3-8a442eea7d90-6c17f803-ce20-4613-9962-18f80b12cb83" by "_create_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-dc2795bd-45b6-4335-8ff3-8a442eea7d90-6c17f803-ce20-4613-9962-18f80b12cb83" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Creating volume 6c17f803-ce20-4613-9962-18f80b12cb83 from snapshot dc2795bd-45b6-4335-8ff3-8a442eea7d90 {{(pid=89807) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-6c17f803-ce20-4613-9962-18f80b12cb83" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-6c17f803-ce20-4613-9962-18f80b12cb83" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] snapshot: dc2795bd-45b6-4335-8ff3-8a442eea7d90, volume: 6c17f803-ce20-4613-9962-18f80b12cb83, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfaf5ca-d5ac-4738-94f7-84f6645e0e4d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:15 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 Sep 05 04:53:15 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:16 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90" returned: 0 in 0.354s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35610908-ed1a-480b-9b2f-d6fcc4eca607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:53:16 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceb34ad-526c-4bd3-aa10-04719a0b07a3]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:16 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 Sep 05 04:53:16 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:16 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607" returned: 0 in 0.344s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:53:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:53:16 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:53:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:16 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 Sep 05 04:53:16 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:20 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83" returned: 0 in 3.941s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607, size 1024.00 MB, duration 3.94 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:53:20 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Converted 1024.00 MB image at 259.70 MB/s Sep 05 04:53:20 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 is being set with open permissions: ugo+rw Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:20 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 Sep 05 04:53:20 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:20 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83" returned: 0 in 0.239s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-6c17f803-ce20-4613-9962-18f80b12cb83" released by "_copy_volume_from_snapshot" :: held 4.953s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-dc2795bd-45b6-4335-8ff3-8a442eea7d90-6c17f803-ce20-4613-9962-18f80b12cb83" released by "_create_volume_from_snapshot" :: held 5.011s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.032s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7c885e-c2f2-4afa-9e66-40f089d1476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c17f803-ce20-4613-9962-18f80b12cb83', 'volume_size': 2, 'snapshot_id': 'dc2795bd-45b6-4335-8ff3-8a442eea7d90'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14a2eda-0098-4c3f-a657-0470c3533eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:20 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Volume volume-6c17f803-ce20-4613-9962-18f80b12cb83 (6c17f803-ce20-4613-9962-18f80b12cb83): created successfully Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14a2eda-0098-4c3f-a657-0470c3533eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:20 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Flow 'volume_create_manager' (093863d7-2a67-4f29-a71d-5df51f8f40f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:53:20 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0ec8ec6e-3653-40aa-8a1e-2a9ccdaff1de tempest-VolumesSnapshotTestJSON-1885129 None] Created volume successfully. Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-6c17f803-ce20-4613-9962-18f80b12cb83-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-6c17f803-ce20-4613-9962-18f80b12cb83-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-6c17f803-ce20-4613-9962-18f80b12cb83" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-6c17f803-ce20-4613-9962-18f80b12cb83" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e278a413-8b89-4c3a-a92f-e38bb56d645e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:21 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 Sep 05 04:53:21 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:21 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83" returned: 0 in 0.352s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:21 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83 Sep 05 04:53:21 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:21 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6c17f803-ce20-4613-9962-18f80b12cb83" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-6c17f803-ce20-4613-9962-18f80b12cb83" released by "delete_volume" :: held 0.645s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Created reservations ['9d759be5-5106-441d-9154-17a1349f0768', '413d3f95-5c0d-46bf-bb43-d82232e02531', '15240741-3d6d-4418-b891-12953ef1d291', '9a2e7b71-b6ed-4348-8c38-f81ca5637447'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:21 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:53:21 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:22 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.241s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:53:22 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Deleted volume successfully. Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3ed3e316-a27e-4c88-9c36-e17e12a3bfce tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-6c17f803-ce20-4613-9962-18f80b12cb83-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-dc2795bd-45b6-4335-8ff3-8a442eea7d90-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-dc2795bd-45b6-4335-8ff3-8a442eea7d90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-35610908-ed1a-480b-9b2f-d6fcc4eca607" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-35610908-ed1a-480b-9b2f-d6fcc4eca607" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-dc2795bd-45b6-4335-8ff3-8a442eea7d90" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-dc2795bd-45b6-4335-8ff3-8a442eea7d90" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Deleting offline snapshot dc2795bd-45b6-4335-8ff3-8a442eea7d90 of volume 35610908-ed1a-480b-9b2f-d6fcc4eca607 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] snapshot_file for this snap is: volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[313831cd-0e66-4b9f-8ec8-244bc0b7180f]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:22 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 Sep 05 04:53:22 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:22 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90" returned: 0 in 0.356s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35610908-ed1a-480b-9b2f-d6fcc4eca607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bc0bdc-0242-4b4a-a619-ca0cc7744d15]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:22 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 Sep 05 04:53:22 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:23 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607" returned: 0 in 0.525s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:23 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 Sep 05 04:53:23 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:23 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90" returned: 0 in 0.324s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:23 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90 Sep 05 04:53:23 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:23 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607.dc2795bd-45b6-4335-8ff3-8a442eea7d90" returned: 0 in 0.243s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-dc2795bd-45b6-4335-8ff3-8a442eea7d90" released by "_delete_snapshot" :: held 1.539s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-35610908-ed1a-480b-9b2f-d6fcc4eca607" released by "delete_snapshot" :: held 1.565s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:23 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Created reservations ['07ef6723-0c6f-4f3c-b258-4b8909d7c6ae', '8f95ab4f-6033-4955-a362-5694cfea467a', '3431b044-150e-4c56-8690-632e6c89f0a7', '73f29824-452e-4ae8-bb19-fc378ce6bb69'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:53:24 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Delete snapshot completed successfully. Sep 05 04:53:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ff7e2fad-b5a4-4c1b-bcbb-d83eebac8d10 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-dc2795bd-45b6-4335-8ff3-8a442eea7d90-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-35610908-ed1a-480b-9b2f-d6fcc4eca607-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-35610908-ed1a-480b-9b2f-d6fcc4eca607-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-35610908-ed1a-480b-9b2f-d6fcc4eca607" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-35610908-ed1a-480b-9b2f-d6fcc4eca607" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:24 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd71dd60-2933-4a9d-8873-ec1fd9b80e3a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:24 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 Sep 05 04:53:24 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:24 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607" returned: 0 in 0.354s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:24 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607 Sep 05 04:53:24 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:25 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-35610908-ed1a-480b-9b2f-d6fcc4eca607" returned: 0 in 0.242s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-35610908-ed1a-480b-9b2f-d6fcc4eca607" released by "delete_volume" :: held 0.651s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Created reservations ['5dfddb3c-d0fc-4432-b6b4-17d43641fcc1', 'c539ec94-683f-4fd9-b67b-7260a0ae488b', '26522576-6c9d-4827-bf04-ed82ec819870', 'dc289d51-f3da-41e1-a42f-4ae51d4d6103'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:25 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:53:25 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:25 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.249s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:53:25 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Deleted volume successfully. Sep 05 04:53:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-183ede18-ccc8-494b-b924-a6b1cf54ba05 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-35610908-ed1a-480b-9b2f-d6fcc4eca607-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Flow 'volume_create_manager' (52f5b31b-f449-4a2d-949f-329b6648b4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37cdce6d-0d4e-4d77-8716-87c5c056cd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37cdce6d-0d4e-4d77-8716-87c5c056cd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1006860857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74627af736874fff8fd8022b691bfdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:53:26Z,use_quota=True,user_id='43a1e273749240ea8b311984f1c99e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e56938f-c018-4b1a-b454-a96bf1f61cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e56938f-c018-4b1a-b454-a96bf1f61cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1ad918-874c-4041-9f98-32729e94139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1ad918-874c-4041-9f98-32729e94139f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cc2ab5-57cd-4ef6-9c19-ce8393a8221f', 'volume_name': 'volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e444688-a98e-429b-bf68-89e7d8c1dd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e444688-a98e-429b-bf68-89e7d8c1dd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c3b8b0-e954-40ac-8d21-a9ce1fc2ddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:26 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Volume d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f', 'volume_size': 1} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1006860857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74627af736874fff8fd8022b691bfdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:53:26Z,use_quota=True,user_id='43a1e273749240ea8b311984f1c99e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Creating volume d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:53:26 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:26 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f 1073741824 Sep 05 04:53:26 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:26 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f 1073741824" returned: 0 in 0.393s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:26 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f Sep 05 04:53:26 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:26 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c3b8b0-e954-40ac-8d21-a9ce1fc2ddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb213cf4-1bd3-4af1-b837-8cc6f6d41a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:26 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Volume volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f (d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f): created successfully Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb213cf4-1bd3-4af1-b837-8cc6f6d41a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Flow 'volume_create_manager' (52f5b31b-f449-4a2d-949f-329b6648b4e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:53:26 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-14ff03ae-febd-44c9-b163-78766f4040a9 tempest-VolumesSnapshotTestJSON-1885129 None] Created volume successfully. Sep 05 04:53:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Creating offline snapshot 0b95dd9e-5c98-40ec-81e6-774bca367c3f of volume d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:53:27 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5372c66d-4c31-44a3-b8a5-3a1719160282]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:27 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f Sep 05 04:53:27 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:27 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" returned: 0 in 0.360s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:27 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f 1G Sep 05 04:53:27 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:28 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f 1G" returned: 0 in 0.377s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:28 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f Sep 05 04:53:28 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:28 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f" returned: 0 in 0.288s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:28 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f is being set with open permissions: ugo+rw Sep 05 04:53:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:28 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f Sep 05 04:53:28 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:28 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f" returned: 0 in 0.244s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:28 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.info Sep 05 04:53:28 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:28 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.info" returned: 0 in 0.244s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:28 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.info is being set with open permissions: ugo+rw Sep 05 04:53:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:28 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.info Sep 05 04:53:28 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:29 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.info" returned: 0 in 0.243s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f4d30d54-e386-4222-9887-f2c45221da9b tempest-VolumesSnapshotTestJSON-1885129 None] Create snapshot completed successfully Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Flow 'volume_create_manager' (f52a20ba-4456-44fe-8585-dbc36bfb0ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788e9cf3-41bf-47cb-9b38-b7446be4f45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788e9cf3-41bf-47cb-9b38-b7446be4f45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2070305030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24fdc1a2-abbc-4070-9b7c-469580fa8afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74627af736874fff8fd8022b691bfdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b95dd9e-5c98-40ec-81e6-774bca367c3f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:53:30Z,use_quota=True,user_id='43a1e273749240ea8b311984f1c99e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16270d82-f68a-4688-83fc-de714663e62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16270d82-f68a-4688-83fc-de714663e62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fd92ad-0699-4d33-af6f-5caa6c22c2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fd92ad-0699-4d33-af6f-5caa6c22c2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24fdc1a2-abbc-4070-9b7c-469580fa8afc', 'volume_name': 'volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc', 'volume_size': 1, 'snapshot_id': '0b95dd9e-5c98-40ec-81e6-774bca367c3f'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536e9ab6-8acb-4df3-9e76-2e142a46e492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536e9ab6-8acb-4df3-9e76-2e142a46e492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f17421-fc53-4319-8a6d-28f10e2c8dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Volume 24fdc1a2-abbc-4070-9b7c-469580fa8afc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc', 'volume_size': 1, 'snapshot_id': '0b95dd9e-5c98-40ec-81e6-774bca367c3f'} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-0b95dd9e-5c98-40ec-81e6-774bca367c3f-24fdc1a2-abbc-4070-9b7c-469580fa8afc" by "_create_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-0b95dd9e-5c98-40ec-81e6-774bca367c3f-24fdc1a2-abbc-4070-9b7c-469580fa8afc" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Creating volume 24fdc1a2-abbc-4070-9b7c-469580fa8afc from snapshot 0b95dd9e-5c98-40ec-81e6-774bca367c3f {{(pid=89807) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:53:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-24fdc1a2-abbc-4070-9b7c-469580fa8afc" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-24fdc1a2-abbc-4070-9b7c-469580fa8afc" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] snapshot: 0b95dd9e-5c98-40ec-81e6-774bca367c3f, volume: 24fdc1a2-abbc-4070-9b7c-469580fa8afc, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2119a279-a62c-402a-a996-ad11206ec3bf]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:30 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f Sep 05 04:53:30 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:30 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f" returned: 0 in 0.346s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d14d11-02d8-4a41-b9b5-63b130fae45c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:30 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f Sep 05 04:53:30 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:30 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" returned: 0 in 0.350s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:53:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:30 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc Sep 05 04:53:30 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:34 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc" returned: 0 in 3.923s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:34 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f, size 1024.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:53:34 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Converted 1024.00 MB image at 260.95 MB/s Sep 05 04:53:34 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc is being set with open permissions: ugo+rw Sep 05 04:53:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:34 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc Sep 05 04:53:34 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:34 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc" returned: 0 in 0.238s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-24fdc1a2-abbc-4070-9b7c-469580fa8afc" released by "_copy_volume_from_snapshot" :: held 4.930s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-0b95dd9e-5c98-40ec-81e6-774bca367c3f-24fdc1a2-abbc-4070-9b7c-469580fa8afc" released by "_create_volume_from_snapshot" :: held 4.992s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f17421-fc53-4319-8a6d-28f10e2c8dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc', 'volume_size': 1, 'snapshot_id': '0b95dd9e-5c98-40ec-81e6-774bca367c3f'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad49c3b0-8dfe-408a-888f-2e3bc28eeac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:53:35 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Volume volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc (24fdc1a2-abbc-4070-9b7c-469580fa8afc): created successfully Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad49c3b0-8dfe-408a-888f-2e3bc28eeac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Flow 'volume_create_manager' (f52a20ba-4456-44fe-8585-dbc36bfb0ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:53:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f9cfe6b9-2209-4952-bb88-73cb0054bb46 tempest-VolumesSnapshotTestJSON-1885129 None] Created volume successfully. Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-24fdc1a2-abbc-4070-9b7c-469580fa8afc-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-24fdc1a2-abbc-4070-9b7c-469580fa8afc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-24fdc1a2-abbc-4070-9b7c-469580fa8afc" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-24fdc1a2-abbc-4070-9b7c-469580fa8afc" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d097b74f-5883-4fcb-9c2b-c3270390f642]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:35 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc Sep 05 04:53:35 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:35 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc" returned: 0 in 0.351s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:35 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc Sep 05 04:53:35 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:36 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-24fdc1a2-abbc-4070-9b7c-469580fa8afc" returned: 0 in 0.249s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-24fdc1a2-abbc-4070-9b7c-469580fa8afc" released by "delete_volume" :: held 0.638s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Created reservations ['cee1e675-afe9-4330-b5d6-351e0bff8c93', '57d11cee-e150-4c9f-a9f0-54f987ce51cc', '41559df5-65e8-4173-aebf-d84249009642', '0bada375-990d-4b88-b4ac-4f4389e01c72'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:36 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:53:36 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:36 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.238s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:53:36 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Deleted volume successfully. Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cb496113-e83c-4c39-8b0f-01852f6e0acd tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-24fdc1a2-abbc-4070-9b7c-469580fa8afc-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-0b95dd9e-5c98-40ec-81e6-774bca367c3f-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-0b95dd9e-5c98-40ec-81e6-774bca367c3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-0b95dd9e-5c98-40ec-81e6-774bca367c3f" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-0b95dd9e-5c98-40ec-81e6-774bca367c3f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Deleting offline snapshot 0b95dd9e-5c98-40ec-81e6-774bca367c3f of volume d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] snapshot_file for this snap is: volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[29178e0e-9222-441a-a472-5ed2302003f8]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:36 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f Sep 05 04:53:36 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:37 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f" returned: 0 in 0.348s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:53:37 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6e550a-d514-4f17-b976-26edb2570add]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:37 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f Sep 05 04:53:37 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:37 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" returned: 0 in 0.541s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:37 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f Sep 05 04:53:37 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:37 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f" returned: 0 in 0.323s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:37 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f Sep 05 04:53:37 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:38 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f.0b95dd9e-5c98-40ec-81e6-774bca367c3f" returned: 0 in 0.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-0b95dd9e-5c98-40ec-81e6-774bca367c3f" released by "_delete_snapshot" :: held 1.551s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" released by "delete_snapshot" :: held 1.573s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Created reservations ['adf28f33-c01f-4c8a-9217-cdb395553ea1', '5b77ca77-e1b0-4d64-9f94-36111029b988', '77b6dd3b-e61f-4721-8345-f29818100696', '05925b62-9a74-4e1f-8977-e50334b1d09c'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:53:38 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Delete snapshot completed successfully. Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5008867-0d04-4ffd-9337-3a2cab0908b3 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-0b95dd9e-5c98-40ec-81e6-774bca367c3f-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[32813f51-8bad-468d-835b-cffa83ba5d28]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:39 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f Sep 05 04:53:39 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:39 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" returned: 0 in 0.359s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:39 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f Sep 05 04:53:39 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:39 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" returned: 0 in 0.248s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f" released by "delete_volume" :: held 0.659s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Created reservations ['5c704d01-d177-44f2-b6a2-867894c0be85', 'dfb3cdf5-24fe-46e2-aa54-ab98f8f8dcce', '11930b3c-eb3a-4280-9aa4-f82cc8f5cd39', 'b2a2922e-1f65-474c-8af4-b9b6c3358b01'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:39 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:53:39 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:39 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.260s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:53:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Deleted volume successfully. Sep 05 04:53:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a5f3a171-ec80-491d-8e45-73cf923583c2 tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-d4cc2ab5-57cd-4ef6-9c19-ce8393a8221f-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-bed2991b-e078-4b23-97a2-4a3d1cf986fa-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-bed2991b-e078-4b23-97a2-4a3d1cf986fa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "cinder-quobyte-bed2991b-e078-4b23-97a2-4a3d1cf986fa" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-bed2991b-e078-4b23-97a2-4a3d1cf986fa" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe995c-f0fd-4a3a-8be1-22a5eb6f6780]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:40 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa Sep 05 04:53:40 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:40 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa" returned: 0 in 0.348s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:40 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa Sep 05 04:53:40 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:40 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bed2991b-e078-4b23-97a2-4a3d1cf986fa" returned: 0 in 0.240s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-quobyte-bed2991b-e078-4b23-97a2-4a3d1cf986fa" released by "delete_volume" :: held 0.645s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Created reservations ['618c0f2b-b6e0-4874-ad55-da6795ade75a', '05dfaff5-8ba8-48e2-8646-ccb3f7ac3684', 'b252b058-9734-4602-937e-e4e6d4c456f7', 'b4256e5b-455a-48cd-9b3f-3e1eed4480ff'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:53:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:53:40 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:53:40 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:53:41 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 05 04:53:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:53:41 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:53:41 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Deleted volume successfully. Sep 05 04:53:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e859b430-c702-443f-9106-bdcb8d90d99e tempest-VolumesSnapshotTestJSON-1885129 None] Lock "cinder-bed2991b-e078-4b23-97a2-4a3d1cf986fa-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:53:50 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=82,cinder:SELECT=61,cinder:INSERT=22,cinder:DELETE=9 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:53:51 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=81,cinder:UPDATE=71,cinder:DELETE=4,cinder:INSERT=18 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Flow 'volume_create_manager' (d1d345dd-62a7-4288-8203-5482acbff2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2526cfda-cb1e-4069-997d-c74ca29a1d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2526cfda-cb1e-4069-997d-c74ca29a1d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1029889619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859de345-1a64-4e80-bfd1-957c3b31e3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec22ecce122f466ab0793fa519e38768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:54:10Z,use_quota=True,user_id='90890cf88feb4573b4bb5a5205061218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(baedd281-fbd9-4c6f-a39b-99601c4070de),volume_type_id=baedd281-fbd9-4c6f-a39b-99601c4070de)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78b7153-51b0-4890-aa6c-b6840831efde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78b7153-51b0-4890-aa6c-b6840831efde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72b391e-e734-40c9-8bc3-9d7b0ce09b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72b391e-e734-40c9-8bc3-9d7b0ce09b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859de345-1a64-4e80-bfd1-957c3b31e3b4', 'volume_name': 'volume-859de345-1a64-4e80-bfd1-957c3b31e3b4', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d34940b-ba4f-4f5e-92de-dc5aebf9ed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d34940b-ba4f-4f5e-92de-dc5aebf9ed00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ce4068-4908-459a-bbc0-c90a50eab7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:09 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Volume 859de345-1a64-4e80-bfd1-957c3b31e3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859de345-1a64-4e80-bfd1-957c3b31e3b4', 'volume_size': 1} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1029889619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859de345-1a64-4e80-bfd1-957c3b31e3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec22ecce122f466ab0793fa519e38768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:54:10Z,use_quota=True,user_id='90890cf88feb4573b4bb5a5205061218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(baedd281-fbd9-4c6f-a39b-99601c4070de),volume_type_id=baedd281-fbd9-4c6f-a39b-99601c4070de)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Creating volume 859de345-1a64-4e80-bfd1-957c3b31e3b4 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:54:09 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:54:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:09 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4 1073741824 Sep 05 04:54:09 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Flow 'volume_create_manager' (903cb400-3fde-4f29-baed-4b2c1018f777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1457d3-87cc-4930-8557-0f28b2ee3039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1457d3-87cc-4930-8557-0f28b2ee3039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1391021804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c41112-0bfa-40c0-aa22-5cc4cf6cc884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec22ecce122f466ab0793fa519e38768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:54:10Z,use_quota=True,user_id='90890cf88feb4573b4bb5a5205061218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89ca65b5-06c4-497b-99bb-c9e8fa5bc098),volume_type_id=89ca65b5-06c4-497b-99bb-c9e8fa5bc098)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9586b5-80b6-4396-bd05-fd8764b5cc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9586b5-80b6-4396-bd05-fd8764b5cc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c12cf89-2d52-476c-8d8c-162fe696442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c12cf89-2d52-476c-8d8c-162fe696442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c41112-0bfa-40c0-aa22-5cc4cf6cc884', 'volume_name': 'volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d7426f-1d8c-40e1-a02f-19546cadd4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d7426f-1d8c-40e1-a02f-19546cadd4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6904b7-40c1-4055-8a6d-7a6a2f6ecc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:10 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Volume 62c41112-0bfa-40c0-aa22-5cc4cf6cc884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884', 'volume_size': 1} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:54:10 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4 1073741824" returned: 0 in 0.494s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:10 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4 Sep 05 04:54:10 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:10 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:54:10 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:10 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4" returned: 0 in 0.275s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1391021804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c41112-0bfa-40c0-aa22-5cc4cf6cc884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec22ecce122f466ab0793fa519e38768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:54:10Z,use_quota=True,user_id='90890cf88feb4573b4bb5a5205061218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89ca65b5-06c4-497b-99bb-c9e8fa5bc098),volume_type_id=89ca65b5-06c4-497b-99bb-c9e8fa5bc098)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Creating volume 62c41112-0bfa-40c0-aa22-5cc4cf6cc884 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:54:10 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ce4068-4908-459a-bbc0-c90a50eab7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859de345-1a64-4e80-bfd1-957c3b31e3b4', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:10 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884 1073741824 Sep 05 04:54:10 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4aca07e-3443-4b89-a4c0-0a04c9ad82a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:10 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Volume volume-859de345-1a64-4e80-bfd1-957c3b31e3b4 (859de345-1a64-4e80-bfd1-957c3b31e3b4): created successfully Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4aca07e-3443-4b89-a4c0-0a04c9ad82a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Flow 'volume_create_manager' (d1d345dd-62a7-4288-8203-5482acbff2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Flow 'volume_create_manager' (f51fe411-63b9-4abd-ae8f-4230571fda36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174e14bc-a895-446e-8f61-bd4b1d29ce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:10 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ca06b91d-29e8-4de5-b413-10ce8195f27d tempest-TestInstancesWithCinderVolumes-477953131 None] Created volume successfully. Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174e14bc-a895-446e-8f61-bd4b1d29ce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1474281216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42093da-5de8-4e38-a4ed-2cb44b1d63fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec22ecce122f466ab0793fa519e38768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:54:11Z,use_quota=True,user_id='90890cf88feb4573b4bb5a5205061218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d5361d5-2061-4428-bf4f-5872cc77d850),volume_type_id=3d5361d5-2061-4428-bf4f-5872cc77d850)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b37d8a-a4c5-4ea4-af75-49568ab4c84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b37d8a-a4c5-4ea4-af75-49568ab4c84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e0be6a-63d9-4b42-b665-b3a205920dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.image.glance [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Creating Keystone auth plugin from conf {{(pid=89807) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 04:54:10 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.291s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:54:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e0be6a-63d9-4b42-b665-b3a205920dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c42093da-5de8-4e38-a4ed-2cb44b1d63fe', 'volume_name': 'volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe', 'volume_size': 1, 'image_id': '24fe8071-ea99-4797-bfa1-1fb59cc20132', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24fe8071-ea99-4797-bfa1-1fb59cc20132', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1614422113', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec22ecce122f466ab0793fa519e38768', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24fe8071-ea99-4797-bfa1-1fb59cc20132', 'created_at': datetime.datetime(2026, 9, 5, 2, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 54, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24fe8071-ea99-4797-bfa1-1fb59cc20132/file', 'properties': {}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de7c322-2f74-4e52-8ef4-4a68b74ef71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:11 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de7c322-2f74-4e52-8ef4-4a68b74ef71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdcb3da-d707-40b2-9dd2-ad82911d5eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:11 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Volume c42093da-5de8-4e38-a4ed-2cb44b1d63fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe', 'volume_size': 1, 'image_id': '24fe8071-ea99-4797-bfa1-1fb59cc20132', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24fe8071-ea99-4797-bfa1-1fb59cc20132', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1614422113', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec22ecce122f466ab0793fa519e38768', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24fe8071-ea99-4797-bfa1-1fb59cc20132', 'created_at': datetime.datetime(2026, 9, 5, 2, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 54, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24fe8071-ea99-4797-bfa1-1fb59cc20132/file', 'properties': {}}, 'image_service': } Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Trying to clone c42093da-5de8-4e38-a4ed-2cb44b1d63fe from image 24fe8071-ea99-4797-bfa1-1fb59cc20132 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24fe8071-ea99-4797-bfa1-1fb59cc20132', 'metadata': {}}]). {{(pid=89807) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884 1073741824" returned: 0 in 0.489s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:11 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884 Sep 05 04:54:11 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:11 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884" returned: 0 in 0.269s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6904b7-40c1-4055-8a6d-7a6a2f6ecc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923a7168-c4fa-422c-80f4-c288fbf4e982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:11 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Volume volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884 (62c41112-0bfa-40c0-aa22-5cc4cf6cc884): created successfully Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923a7168-c4fa-422c-80f4-c288fbf4e982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Flow 'volume_create_manager' (903cb400-3fde-4f29-baed-4b2c1018f777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:54:11 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-62a734a8-8cb6-40da-a5dd-c8098dd5f8fc tempest-TestInstancesWithCinderVolumes-477953131 None] Created volume successfully. Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD, size 20.69 MB, duration 2.86 sec {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 04:54:14 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Image download 20.69 MB at 7.23 MB/s Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29859f3-fcc9-4199-925a-0c4bfec4d06a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:14 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD Sep 05 04:54:14 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:14 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Temporary image 24fe8071-ea99-4797-bfa1-1fb59cc20132 is fetched for user 90890cf88feb4573b4bb5a5205061218. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77787a1-6659-47d0-83af-07ab80da0277]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:14 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD Sep 05 04:54:14 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:14 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1474281216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42093da-5de8-4e38-a4ed-2cb44b1d63fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec22ecce122f466ab0793fa519e38768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:54:11Z,use_quota=True,user_id='90890cf88feb4573b4bb5a5205061218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d5361d5-2061-4428-bf4f-5872cc77d850),volume_type_id=3d5361d5-2061-4428-bf4f-5872cc77d850)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Creating volume c42093da-5de8-4e38-a4ed-2cb44b1d63fe {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:54:14 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:54:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:14 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe 1073741824 Sep 05 04:54:14 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:15 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe 1073741824" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:15 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe Sep 05 04:54:15 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:15 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:54:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:54:15 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Attempting download of 24fe8071-ea99-4797-bfa1-1fb59cc20132 ((None, [{'url': 'file:///opt/stack/data/glance/images/24fe8071-ea99-4797-bfa1-1fb59cc20132', 'metadata': {}}])) to volume c42093da-5de8-4e38-a4ed-2cb44b1d63fe. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 04:54:15 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea367cf-63b0-4972-8a1d-4d9ca9813731]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:54:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24fe8071-ea99-4797-bfa1-1fb59cc20132_xzx1cvc6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:15 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24fe8071-ea99-4797-bfa1-1fb59cc20132_xzx1cvc6 Sep 05 04:54:15 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:16 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24fe8071-ea99-4797-bfa1-1fb59cc20132_xzx1cvc6" returned: 0 in 0.335s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24fe8071-ea99-4797-bfa1-1fb59cc20132_xzx1cvc6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:16 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24fe8071-ea99-4797-bfa1-1fb59cc20132_xzx1cvc6 Sep 05 04:54:16 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:16 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24fe8071-ea99-4797-bfa1-1fb59cc20132_xzx1cvc6" returned: 1 in 0.319s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24fe8071-ea99-4797-bfa1-1fb59cc20132_xzx1cvc6' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:54:16 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30479ff-6caa-4d18-9268-79b82d738611]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:54:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:16 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD Sep 05 04:54:16 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:16 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:16 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] 24fe8071-ea99-4797-bfa1-1fb59cc20132 was qcow2, converting to qcow2 {{(pid=89807) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 04:54:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:16 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe Sep 05 04:54:16 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:18 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe" returned: 0 in 1.551s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24fe8071-ea99-4797-bfa1-1fb59cc20132_4d4ypcwldevstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:54:18 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Converted 112.00 MB image at 72.14 MB/s Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:54:18 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe 1G Sep 05 04:54:18 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:54:18 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe 1G" returned: 0 in 0.304s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Downloaded image 24fe8071-ea99-4797-bfa1-1fb59cc20132 ((None, [{'url': 'file:///opt/stack/data/glance/images/24fe8071-ea99-4797-bfa1-1fb59cc20132', 'metadata': {}}])) to volume c42093da-5de8-4e38-a4ed-2cb44b1d63fe successfully. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Temporary image 24fe8071-ea99-4797-bfa1-1fb59cc20132 for user 90890cf88feb4573b4bb5a5205061218 is deleted. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Marking volume c42093da-5de8-4e38-a4ed-2cb44b1d63fe as bootable. {{(pid=89807) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Copying metadata from image 24fe8071-ea99-4797-bfa1-1fb59cc20132 to c42093da-5de8-4e38-a4ed-2cb44b1d63fe. {{(pid=89807) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Creating volume glance metadata for volume c42093da-5de8-4e38-a4ed-2cb44b1d63fe backed by image 24fe8071-ea99-4797-bfa1-1fb59cc20132 with: {'image_id': '24fe8071-ea99-4797-bfa1-1fb59cc20132', 'image_name': 'tempest-scenario-img--1614422113', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89807) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdcb3da-d707-40b2-9dd2-ad82911d5eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe', 'volume_size': 1, 'image_id': '24fe8071-ea99-4797-bfa1-1fb59cc20132', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24fe8071-ea99-4797-bfa1-1fb59cc20132', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1614422113', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec22ecce122f466ab0793fa519e38768', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24fe8071-ea99-4797-bfa1-1fb59cc20132', 'created_at': datetime.datetime(2026, 9, 5, 2, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 54, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24fe8071-ea99-4797-bfa1-1fb59cc20132/file', 'properties': {}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1e4572-4bfa-45b0-be55-d62c30132610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:54:18 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Volume volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe (c42093da-5de8-4e38-a4ed-2cb44b1d63fe): created successfully Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1e4572-4bfa-45b0-be55-d62c30132610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:54:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Flow 'volume_create_manager' (f51fe411-63b9-4abd-ae8f-4230571fda36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:54:18 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-860cf045-da15-480f-8296-ffd0179b8b9d tempest-TestInstancesWithCinderVolumes-477953131 None] Created volume successfully. Sep 05 04:54:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-e81b5a70-2e5c-4b97-945f-26e14c955b07 req-73d26159-3393-4e29-a196-31987ce1710c tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:54:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-e81b5a70-2e5c-4b97-945f-26e14c955b07 req-73d26159-3393-4e29-a196-31987ce1710c tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:54:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-e81b5a70-2e5c-4b97-945f-26e14c955b07 req-73d26159-3393-4e29-a196-31987ce1710c tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:54:22 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-e81b5a70-2e5c-4b97-945f-26e14c955b07 req-73d26159-3393-4e29-a196-31987ce1710c tempest-TestInstancesWithCinderVolumes-477953131 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cc4c0b5-19e3-409a-b302-449717ff0bbd', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:54:22 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-e81b5a70-2e5c-4b97-945f-26e14c955b07 req-73d26159-3393-4e29-a196-31987ce1710c tempest-TestInstancesWithCinderVolumes-477953131 None] attachment_update completed successfully. Sep 05 04:54:32 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=19,cinder:UPDATE=14,cinder:INSERT=6,cinder:DELETE=3 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:54:32 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:INSERT=6 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:54:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-defc8996-d518-43aa-a079-23af1cd3b208 req-bb790be0-3c9c-4960-94a3-e024f4a69304 tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:54:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-defc8996-d518-43aa-a079-23af1cd3b208 req-bb790be0-3c9c-4960-94a3-e024f4a69304 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:54:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-defc8996-d518-43aa-a079-23af1cd3b208 req-bb790be0-3c9c-4960-94a3-e024f4a69304 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:54:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-defc8996-d518-43aa-a079-23af1cd3b208 req-bb790be0-3c9c-4960-94a3-e024f4a69304 tempest-TestInstancesWithCinderVolumes-477953131 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-859de345-1a64-4e80-bfd1-957c3b31e3b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b23dfc51-e51f-40e4-9ae5-4db9903b638e', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:54:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-defc8996-d518-43aa-a079-23af1cd3b208 req-bb790be0-3c9c-4960-94a3-e024f4a69304 tempest-TestInstancesWithCinderVolumes-477953131 None] attachment_update completed successfully. Sep 05 04:54:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-7b5afac1-8b89-4140-8915-3aa00f9a3be9 req-2d42f2f3-2045-48b4-83e2-71d688366aed tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:54:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-7b5afac1-8b89-4140-8915-3aa00f9a3be9 req-2d42f2f3-2045-48b4-83e2-71d688366aed tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:54:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-7b5afac1-8b89-4140-8915-3aa00f9a3be9 req-2d42f2f3-2045-48b4-83e2-71d688366aed tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:54:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-7b5afac1-8b89-4140-8915-3aa00f9a3be9 req-2d42f2f3-2045-48b4-83e2-71d688366aed tempest-TestInstancesWithCinderVolumes-477953131 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '799e45b7-bc01-4f17-a24d-935ca931d3f7', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:54:55 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-7b5afac1-8b89-4140-8915-3aa00f9a3be9 req-2d42f2f3-2045-48b4-83e2-71d688366aed tempest-TestInstancesWithCinderVolumes-477953131 None] attachment_update completed successfully. Sep 05 04:54:59 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-2a70a567-082c-49ad-9a58-29d9b542493f req-3d9fa31b-1db5-43fc-b5ef-a9992b100c9b tempest-TestInstancesWithCinderVolumes-477953131 None] Terminate volume connection completed successfully. Sep 05 04:54:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-2a70a567-082c-49ad-9a58-29d9b542493f req-3d9fa31b-1db5-43fc-b5ef-a9992b100c9b tempest-TestInstancesWithCinderVolumes-477953131 None] Deleting attachment b23dfc51-e51f-40e4-9ae5-4db9903b638e. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:55:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "cinder-859de345-1a64-4e80-bfd1-957c3b31e3b4-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:55:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-859de345-1a64-4e80-bfd1-957c3b31e3b4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:55:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "cinder-quobyte-859de345-1a64-4e80-bfd1-957c3b31e3b4" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:55:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-quobyte-859de345-1a64-4e80-bfd1-957c3b31e3b4" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:55:00 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c76b6f0-76af-419a-94df-24ef7cbad4ff]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:55:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:00 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4 Sep 05 04:55:00 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:00 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4" returned: 0 in 0.388s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:00 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4 Sep 05 04:55:00 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:00 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-859de345-1a64-4e80-bfd1-957c3b31e3b4" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-quobyte-859de345-1a64-4e80-bfd1-957c3b31e3b4" released by "delete_volume" :: held 0.681s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:55:00 devstack cinder-volume[89807]: WARNING cinder.quota [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1675532224-1086922732 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1675532224-1086922732, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:55:00 devstack cinder-volume[89807]: WARNING cinder.quota [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1675532224-1086922732 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1675532224-1086922732, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:55:01 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Created reservations ['a864c5a7-5653-493b-a079-a21cba6ef714', 'f3c74928-e524-4ce5-818c-0d605af0b777', '569425a5-8a1c-4066-9544-8e96a78e2131', '67b289a7-45f6-4abc-a8ae-0631c8386d2c'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:55:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:55:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:55:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:55:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:55:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:55:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:01 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:55:01 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:01 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.264s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:01 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:55:01 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Deleted volume successfully. Sep 05 04:55:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5e533976-e326-4e01-8bb4-39806ae73ed1 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-859de345-1a64-4e80-bfd1-957c3b31e3b4-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:55:03 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-488e73ec-f799-425f-92c9-60a6b4301a9c req-426979f2-2d4a-4319-aac7-394225f5f3be tempest-TestInstancesWithCinderVolumes-477953131 None] Terminate volume connection completed successfully. Sep 05 04:55:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-488e73ec-f799-425f-92c9-60a6b4301a9c req-426979f2-2d4a-4319-aac7-394225f5f3be tempest-TestInstancesWithCinderVolumes-477953131 None] Deleting attachment 799e45b7-bc01-4f17-a24d-935ca931d3f7. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:55:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "cinder-62c41112-0bfa-40c0-aa22-5cc4cf6cc884-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:55:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-62c41112-0bfa-40c0-aa22-5cc4cf6cc884-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:55:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "cinder-quobyte-62c41112-0bfa-40c0-aa22-5cc4cf6cc884" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:55:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-quobyte-62c41112-0bfa-40c0-aa22-5cc4cf6cc884" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:55:04 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5c05bf-ad91-4338-a936-c863b0f2e7f9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:55:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:04 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884 Sep 05 04:55:04 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:04 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884" returned: 0 in 0.371s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:04 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884 Sep 05 04:55:04 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:05 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-62c41112-0bfa-40c0-aa22-5cc4cf6cc884" returned: 0 in 0.267s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-quobyte-62c41112-0bfa-40c0-aa22-5cc4cf6cc884" released by "delete_volume" :: held 0.682s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:55:05 devstack cinder-volume[89807]: WARNING cinder.quota [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-386708024-285615687 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-386708024-285615687, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:55:05 devstack cinder-volume[89807]: WARNING cinder.quota [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-386708024-285615687 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-386708024-285615687, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Created reservations ['21bd1748-4f2c-46c6-af69-ac3f8d0cacd4', '94bdb944-4f7c-4fb4-a29b-feeb442f07f0', 'ee4494c4-fed8-47a6-a041-7e13aec6115e', '76a6d4ee-e5d7-47c7-8e71-7a42afb56eb3'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:05 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:55:05 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:05 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.279s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:55:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Deleted volume successfully. Sep 05 04:55:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3c010317-0d76-448c-bac8-6969d4c3a0a5 tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-62c41112-0bfa-40c0-aa22-5cc4cf6cc884-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:55:08 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-5f50beda-7ca7-4cc2-b8fe-5d900878bc7b req-184cd81d-586c-41f1-9e45-5ca51f053b19 tempest-TestInstancesWithCinderVolumes-477953131 None] Terminate volume connection completed successfully. Sep 05 04:55:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-5f50beda-7ca7-4cc2-b8fe-5d900878bc7b req-184cd81d-586c-41f1-9e45-5ca51f053b19 tempest-TestInstancesWithCinderVolumes-477953131 None] Deleting attachment 4cc4c0b5-19e3-409a-b302-449717ff0bbd. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "cinder-c42093da-5de8-4e38-a4ed-2cb44b1d63fe-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-c42093da-5de8-4e38-a4ed-2cb44b1d63fe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "cinder-quobyte-c42093da-5de8-4e38-a4ed-2cb44b1d63fe" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-quobyte-c42093da-5de8-4e38-a4ed-2cb44b1d63fe" acquired by "delete_volume" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a093602f-dd6c-454b-b312-a796b011024c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:09 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe Sep 05 04:55:09 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:09 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe" returned: 0 in 0.356s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:09 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe Sep 05 04:55:09 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:09 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c42093da-5de8-4e38-a4ed-2cb44b1d63fe" returned: 0 in 0.240s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-quobyte-c42093da-5de8-4e38-a4ed-2cb44b1d63fe" released by "delete_volume" :: held 0.632s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:55:09 devstack cinder-volume[89807]: WARNING cinder.quota [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1731989728-738231016 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1731989728-738231016, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:55:09 devstack cinder-volume[89807]: WARNING cinder.quota [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1731989728-738231016 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1731989728-738231016, it is now deprecated. Please use the default quota class for default quota. Sep 05 04:55:09 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Created reservations ['80719f81-68d2-460a-b7ec-09e2e4933a2f', 'fb7c7074-4c4e-4884-b51c-08356308ffde', 'bed112cf-70a1-4b47-9366-b0374659068e', 'f2703bc9-d45e-4b5f-9ad8-1400c56728bb'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:10 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:55:10 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:10 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:55:10 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Deleted volume successfully. Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2947614c-0085-44f1-b0df-b3d04445930a tempest-TestInstancesWithCinderVolumes-477953131 None] Lock "cinder-c42093da-5de8-4e38-a4ed-2cb44b1d63fe-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:10 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:55:10 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:10 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.283s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:55:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:55:19 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=35,cinder:UPDATE=26,cinder:INSERT=7 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:55:20 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=3 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Flow 'volume_create_manager' (7c44ecba-ff1f-4305-bd5d-f80757343e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1879e0d7-07b1-47e3-8de2-95533f096e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1879e0d7-07b1-47e3-8de2-95533f096e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-994839941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120fb7e8bc3d45159764a3c777d21934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:55:41Z,use_quota=True,user_id='29ecd4d7fef74ec7bc57ec1262b7183b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0204bd23-d5c2-439c-8c15-776ba8f19c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0204bd23-d5c2-439c-8c15-776ba8f19c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf174c40-045a-4806-8bf2-7958c88eeb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf174c40-045a-4806-8bf2-7958c88eeb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d', 'volume_name': 'volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08e7d60-1fad-4c95-8ae6-d0760d262f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08e7d60-1fad-4c95-8ae6-d0760d262f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72ca336-e4e4-4d1d-af32-1eb86997a033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:55:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Volume 6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d', 'volume_size': 1} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-994839941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120fb7e8bc3d45159764a3c777d21934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:55:41Z,use_quota=True,user_id='29ecd4d7fef74ec7bc57ec1262b7183b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Creating volume 6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:55:41 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:41 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d 1073741824 Sep 05 04:55:41 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:41 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d 1073741824" returned: 0 in 0.440s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:55:41 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d Sep 05 04:55:41 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:55:42 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 05 04:55:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" returned: 0 in 0.277s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:55:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:55:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:55:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72ca336-e4e4-4d1d-af32-1eb86997a033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:55:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3095d1-f51c-48a6-bec0-9151bc2968e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:55:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Volume volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d (6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d): created successfully Sep 05 04:55:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3095d1-f51c-48a6-bec0-9151bc2968e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:55:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Flow 'volume_create_manager' (7c44ecba-ff1f-4305-bd5d-f80757343e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:55:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ce1953bc-096b-49f4-b134-90ae5ad618fb tempest-TestStampPattern-107781459 None] Created volume successfully. Sep 05 04:55:52 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:55:52 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:10 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:56:10 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:10 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.274s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:56:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:56:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-54f46a0a-8a0d-477d-9312-d3dc13faedee req-8d2ad16a-1698-4b2d-8b5e-96d49bb4bb83 tempest-TestStampPattern-107781459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:56:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-54f46a0a-8a0d-477d-9312-d3dc13faedee req-8d2ad16a-1698-4b2d-8b5e-96d49bb4bb83 tempest-TestStampPattern-107781459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:56:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-54f46a0a-8a0d-477d-9312-d3dc13faedee req-8d2ad16a-1698-4b2d-8b5e-96d49bb4bb83 tempest-TestStampPattern-107781459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:56:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-54f46a0a-8a0d-477d-9312-d3dc13faedee req-8d2ad16a-1698-4b2d-8b5e-96d49bb4bb83 tempest-TestStampPattern-107781459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e139a04e-f8a7-482f-b585-3f845a4b611c', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:56:11 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-54f46a0a-8a0d-477d-9312-d3dc13faedee req-8d2ad16a-1698-4b2d-8b5e-96d49bb4bb83 tempest-TestStampPattern-107781459 None] attachment_update completed successfully. Sep 05 04:56:14 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-dbacf853-98c6-47cd-921e-bebd5f6ee3e2 req-ca2168ca-d16e-413c-abb2-b73f852acd0b tempest-TestStampPattern-107781459 None] Terminate volume connection completed successfully. Sep 05 04:56:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-dbacf853-98c6-47cd-921e-bebd5f6ee3e2 req-ca2168ca-d16e-413c-abb2-b73f852acd0b tempest-TestStampPattern-107781459 None] Deleting attachment e139a04e-f8a7-482f-b585-3f845a4b611c. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:56:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:56:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:56:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Creating offline snapshot 06bae0d0-738b-4c88-bc55-8567b9bf114b of volume 6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:56:15 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[266f1e82-6784-4baa-8205-8e2cfb53059b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:56:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:16 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d Sep 05 04:56:16 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:16 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" returned: 0 in 0.359s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:16 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b 1G Sep 05 04:56:16 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:16 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b 1G" returned: 0 in 0.388s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:16 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b Sep 05 04:56:16 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:16 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b" returned: 0 in 0.289s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:16 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b is being set with open permissions: ugo+rw Sep 05 04:56:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:16 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b Sep 05 04:56:16 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:17 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:17 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.info Sep 05 04:56:17 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:17 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.info" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:17 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.info is being set with open permissions: ugo+rw Sep 05 04:56:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:17 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.info Sep 05 04:56:17 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:17 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.info" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:56:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3532fe7d-8e7c-49d2-82ff-f241295283b0 tempest-TestStampPattern-107781459 None] Create snapshot completed successfully Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Flow 'volume_create_manager' (524e8d8d-6a2d-43db-9c18-e0382ffbfbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a67fa36-f986-486c-a275-fb6ea23d67e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a67fa36-f986-486c-a275-fb6ea23d67e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-108409112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b5f7f1-acb8-41fe-8984-0708e124af6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120fb7e8bc3d45159764a3c777d21934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06bae0d0-738b-4c88-bc55-8567b9bf114b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:56:25Z,use_quota=True,user_id='29ecd4d7fef74ec7bc57ec1262b7183b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63037301-01e7-4c11-975b-0187a078bdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63037301-01e7-4c11-975b-0187a078bdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b53ce0-174d-48d5-acc2-20008476187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b53ce0-174d-48d5-acc2-20008476187d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60b5f7f1-acb8-41fe-8984-0708e124af6e', 'volume_name': 'volume-60b5f7f1-acb8-41fe-8984-0708e124af6e', 'volume_size': 1, 'snapshot_id': '06bae0d0-738b-4c88-bc55-8567b9bf114b'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12704f7c-ba93-4331-8659-b906b34c0c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12704f7c-ba93-4331-8659-b906b34c0c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de685c6-21ab-4317-9a25-d77bea9c33d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:56:24 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Volume 60b5f7f1-acb8-41fe-8984-0708e124af6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60b5f7f1-acb8-41fe-8984-0708e124af6e', 'volume_size': 1, 'snapshot_id': '06bae0d0-738b-4c88-bc55-8567b9bf114b'} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Acquiring lock "cinder-quobyte-06bae0d0-738b-4c88-bc55-8567b9bf114b-60b5f7f1-acb8-41fe-8984-0708e124af6e" by "_create_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-06bae0d0-738b-4c88-bc55-8567b9bf114b-60b5f7f1-acb8-41fe-8984-0708e124af6e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Creating volume 60b5f7f1-acb8-41fe-8984-0708e124af6e from snapshot 06bae0d0-738b-4c88-bc55-8567b9bf114b {{(pid=89807) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Acquiring lock "cinder-quobyte-60b5f7f1-acb8-41fe-8984-0708e124af6e" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-60b5f7f1-acb8-41fe-8984-0708e124af6e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] snapshot: 06bae0d0-738b-4c88-bc55-8567b9bf114b, volume: 60b5f7f1-acb8-41fe-8984-0708e124af6e, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40d97e0-7b7b-418f-8cfb-85f43d35ec2d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:56:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:24 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b Sep 05 04:56:24 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:25 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b" returned: 0 in 0.397s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:56:25 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba04ad8-6d5f-428c-aa43-86b35398b639]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:56:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:25 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d Sep 05 04:56:25 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:25 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:56:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:56:25 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:56:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:25 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e Sep 05 04:56:25 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:31 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e" returned: 0 in 5.778s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:56:31 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Converted 1024.00 MB image at 177.13 MB/s Sep 05 04:56:31 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e is being set with open permissions: ugo+rw Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:56:31 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e Sep 05 04:56:31 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:56:31 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e" returned: 0 in 0.284s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-60b5f7f1-acb8-41fe-8984-0708e124af6e" released by "_copy_volume_from_snapshot" :: held 6.961s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-06bae0d0-738b-4c88-bc55-8567b9bf114b-60b5f7f1-acb8-41fe-8984-0708e124af6e" released by "_create_volume_from_snapshot" :: held 7.042s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.060s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de685c6-21ab-4317-9a25-d77bea9c33d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b5f7f1-acb8-41fe-8984-0708e124af6e', 'volume_size': 1, 'snapshot_id': '06bae0d0-738b-4c88-bc55-8567b9bf114b'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcae327-c4ce-4cd9-a8f7-843494dfd473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:56:31 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Volume volume-60b5f7f1-acb8-41fe-8984-0708e124af6e (60b5f7f1-acb8-41fe-8984-0708e124af6e): created successfully Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcae327-c4ce-4cd9-a8f7-843494dfd473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:56:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Flow 'volume_create_manager' (524e8d8d-6a2d-43db-9c18-e0382ffbfbe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:56:31 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c63865a4-e2fd-46e0-bd1a-169f81a15e47 tempest-TestStampPattern-107781459 None] Created volume successfully. Sep 05 04:56:41 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:56:41 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=2 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:10 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:57:10 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:10 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.249s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:57:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:57:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-82cd08c1-94b1-4920-8788-9c4cb568e8ea req-d9119b4d-da58-4e2d-bd7d-05edd2498cbf tempest-TestStampPattern-107781459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-82cd08c1-94b1-4920-8788-9c4cb568e8ea req-d9119b4d-da58-4e2d-bd7d-05edd2498cbf tempest-TestStampPattern-107781459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [req-82cd08c1-94b1-4920-8788-9c4cb568e8ea req-d9119b4d-da58-4e2d-bd7d-05edd2498cbf tempest-TestStampPattern-107781459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:14 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-82cd08c1-94b1-4920-8788-9c4cb568e8ea req-d9119b4d-da58-4e2d-bd7d-05edd2498cbf tempest-TestStampPattern-107781459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b', 'name': 'volume-60b5f7f1-acb8-41fe-8984-0708e124af6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d58f8b6-40dd-44f3-8144-6c1ec34eefe6', 'enforce_multipath': True} {{(pid=89807) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 04:57:14 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-82cd08c1-94b1-4920-8788-9c4cb568e8ea req-d9119b4d-da58-4e2d-bd7d-05edd2498cbf tempest-TestStampPattern-107781459 None] attachment_update completed successfully. Sep 05 04:57:16 devstack cinder-volume[89807]: INFO cinder.volume.manager [req-5628a475-5995-4726-9f2e-0c340b76cc42 req-dbf9d76f-f89c-4f9a-8458-61a07e08a2f8 tempest-TestStampPattern-107781459 None] Terminate volume connection completed successfully. Sep 05 04:57:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [req-5628a475-5995-4726-9f2e-0c340b76cc42 req-dbf9d76f-f89c-4f9a-8458-61a07e08a2f8 tempest-TestStampPattern-107781459 None] Deleting attachment 6d58f8b6-40dd-44f3-8144-6c1ec34eefe6. {{(pid=89807) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 04:57:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Acquiring lock "cinder-60b5f7f1-acb8-41fe-8984-0708e124af6e-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Lock "cinder-60b5f7f1-acb8-41fe-8984-0708e124af6e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Acquiring lock "cinder-quobyte-60b5f7f1-acb8-41fe-8984-0708e124af6e" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-60b5f7f1-acb8-41fe-8984-0708e124af6e" acquired by "delete_volume" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3233c8-ee5d-443e-b6e5-b61999628b9b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:21 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e Sep 05 04:57:21 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:21 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e" returned: 0 in 0.370s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:21 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e Sep 05 04:57:21 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:21 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-60b5f7f1-acb8-41fe-8984-0708e124af6e" returned: 0 in 0.248s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-60b5f7f1-acb8-41fe-8984-0708e124af6e" released by "delete_volume" :: held 0.657s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Created reservations ['034a901d-d9de-49fa-ab86-be516f6705b8', 'f8ddadea-f85a-4a11-a412-6d645b3685dd', 'c9743a50-9837-4df2-9c0c-e6f45cc12bac', '1f7ca269-c129-446a-b6e1-3f1996fd4e89'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:21 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:57:21 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:22 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:57:22 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Deleted volume successfully. Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3812d89b-249c-4eeb-95c1-3623afba35e9 tempest-TestStampPattern-107781459 None] Lock "cinder-60b5f7f1-acb8-41fe-8984-0708e124af6e-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Acquiring lock "cinder-06bae0d0-738b-4c88-bc55-8567b9bf114b-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Lock "cinder-06bae0d0-738b-4c88-bc55-8567b9bf114b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Acquiring lock "cinder-quobyte-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Acquiring lock "cinder-quobyte-06bae0d0-738b-4c88-bc55-8567b9bf114b" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-06bae0d0-738b-4c88-bc55-8567b9bf114b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Deleting offline snapshot 06bae0d0-738b-4c88-bc55-8567b9bf114b of volume 6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] snapshot_file for this snap is: volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8179b1-e5bd-40ab-9e8f-85db67a047b2]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:22 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b Sep 05 04:57:22 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:22 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b" returned: 0 in 0.387s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[03435370-c175-4829-b458-1c4769993d03]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:57:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:23 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d Sep 05 04:57:23 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:23 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" returned: 0 in 0.553s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:23 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b Sep 05 04:57:23 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:23 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b" returned: 0 in 0.341s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:23 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b Sep 05 04:57:23 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:24 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d.06bae0d0-738b-4c88-bc55-8567b9bf114b" returned: 0 in 0.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-06bae0d0-738b-4c88-bc55-8567b9bf114b" released by "_delete_snapshot" :: held 1.639s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" released by "delete_snapshot" :: held 1.662s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:24 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Created reservations ['71362738-0073-4cca-99d4-dce1d5e51932', '76a45220-71fc-42cf-8580-b063b4bc3ddd', '8e2b54b0-4f2b-4a93-80e7-ddc740f30a07', '8295872b-40b0-42d7-bab8-591e37d43b67'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:57:24 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Delete snapshot completed successfully. Sep 05 04:57:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cc576620-d6d6-4adf-b1fb-c71ce690f5f4 tempest-TestStampPattern-107781459 None] Lock "cinder-06bae0d0-738b-4c88-bc55-8567b9bf114b-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Acquiring lock "cinder-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Lock "cinder-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Acquiring lock "cinder-quobyte-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4bc464-6e5b-45ea-adcd-fe00a7dc6931]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:28 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d Sep 05 04:57:28 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:28 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" returned: 0 in 0.380s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:28 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d Sep 05 04:57:28 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:28 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" returned: 0 in 0.247s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Lock "cinder-quobyte-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d" released by "delete_volume" :: held 0.680s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Created reservations ['13217ee3-bf8d-4cca-8d2e-6c70e1fdcf58', '2b0d9ce1-2aac-45cd-a685-b9c83acd20af', '9e1b9bf0-74df-4693-b1c2-67399435e382', 'e5745e9b-a8c7-45d9-a5d4-0ba750f66004'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:28 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:57:28 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:29 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:29 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:57:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Deleted volume successfully. Sep 05 04:57:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d236ce84-4620-4eba-8ba0-4904261d341b tempest-TestStampPattern-107781459 None] Lock "cinder-6886c6a6-ac8d-4f38-9ece-7c1e2c69d11d-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:38 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=25,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:57:39 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=21,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Flow 'volume_create_manager' (0d8ccad9-24e8-445d-980a-c52bb5a4fadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb75528-cc22-44bd-82c0-9dbb9c5db646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb75528-cc22-44bd-82c0-9dbb9c5db646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974584507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc63c3e-e95c-4d2f-a165-dab007aadc53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f48fc860b43498e026219f3ff6907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:57:41Z,use_quota=True,user_id='434c42ea351f4f71ab48bb924f954bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ba81d2-ee18-4fd5-948f-bc9ee0f8bfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ba81d2-ee18-4fd5-948f-bc9ee0f8bfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7528c903-e016-48ce-a2a8-638a275dd2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7528c903-e016-48ce-a2a8-638a275dd2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc63c3e-e95c-4d2f-a165-dab007aadc53', 'volume_name': 'volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d3ed69-2cab-4fa2-84a2-adcd7c5fb2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d3ed69-2cab-4fa2-84a2-adcd7c5fb2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58b7c3a-13a4-4627-bf41-34e82e7e97a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:40 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Volume 5bc63c3e-e95c-4d2f-a165-dab007aadc53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53', 'volume_size': 1} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974584507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc63c3e-e95c-4d2f-a165-dab007aadc53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f48fc860b43498e026219f3ff6907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:57:41Z,use_quota=True,user_id='434c42ea351f4f71ab48bb924f954bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Creating volume 5bc63c3e-e95c-4d2f-a165-dab007aadc53 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:57:40 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:57:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:40 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53 1073741824 Sep 05 04:57:40 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:41 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53 1073741824" returned: 0 in 0.405s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:41 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53 Sep 05 04:57:41 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:41 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53" returned: 0 in 0.239s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58b7c3a-13a4-4627-bf41-34e82e7e97a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a789d4-e36f-4a3c-88f6-cc17cbaeec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Volume volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53 (5bc63c3e-e95c-4d2f-a165-dab007aadc53): created successfully Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a789d4-e36f-4a3c-88f6-cc17cbaeec9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Flow 'volume_create_manager' (0d8ccad9-24e8-445d-980a-c52bb5a4fadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:57:41 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e2104280-d46b-468a-bdc3-d186e0f59888 tempest-ProjectReaderTests-1180738628 None] Created volume successfully. Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Acquiring lock "cinder-5bc63c3e-e95c-4d2f-a165-dab007aadc53-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Lock "cinder-5bc63c3e-e95c-4d2f-a165-dab007aadc53-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Acquiring lock "cinder-quobyte-5bc63c3e-e95c-4d2f-a165-dab007aadc53" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Lock "cinder-quobyte-5bc63c3e-e95c-4d2f-a165-dab007aadc53" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[970ac5b4-eab4-499c-823c-ecf4ce6ffa81]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:57:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:42 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53 Sep 05 04:57:42 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:42 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53" returned: 0 in 0.358s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:42 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53 Sep 05 04:57:42 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:42 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5bc63c3e-e95c-4d2f-a165-dab007aadc53" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Lock "cinder-quobyte-5bc63c3e-e95c-4d2f-a165-dab007aadc53" released by "delete_volume" :: held 0.638s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Created reservations ['c668bd36-3486-440e-a308-8b075c79f0e4', 'ba2c0d7e-4f9d-4bcf-b330-04458fadeb72', 'd6d5df28-0f01-415b-9c9d-044b2abb59af', 'b70d0737-f60f-4666-9e9e-2f552b2c0080'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:42 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:57:42 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:42 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.271s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:57:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Deleted volume successfully. Sep 05 04:57:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-42f2f950-1387-4e18-80de-53b8175f42a1 tempest-ProjectReaderTests-1180738628 None] Lock "cinder-5bc63c3e-e95c-4d2f-a165-dab007aadc53-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Flow 'volume_create_manager' (61063234-9bff-4be6-8c62-ac336bf9dac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416c611d-1631-4afd-9cff-a354907db50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416c611d-1631-4afd-9cff-a354907db50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2025922554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8659b3c-e208-4ef8-9b84-90f1271dfdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f48fc860b43498e026219f3ff6907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:57:43Z,use_quota=True,user_id='434c42ea351f4f71ab48bb924f954bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c1133e-f4a7-4325-8d48-995beb21929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c1133e-f4a7-4325-8d48-995beb21929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1b863f-17e4-4229-aa3b-3c105efdbee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1b863f-17e4-4229-aa3b-3c105efdbee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8659b3c-e208-4ef8-9b84-90f1271dfdcf', 'volume_name': 'volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2cdde7-7114-4fcc-b4cf-44da48e3cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2cdde7-7114-4fcc-b4cf-44da48e3cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0caa7a2f-5b54-4778-8eb8-ad8937575845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:43 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Volume e8659b3c-e208-4ef8-9b84-90f1271dfdcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf', 'volume_size': 1} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2025922554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8659b3c-e208-4ef8-9b84-90f1271dfdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f48fc860b43498e026219f3ff6907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:57:43Z,use_quota=True,user_id='434c42ea351f4f71ab48bb924f954bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Creating volume e8659b3c-e208-4ef8-9b84-90f1271dfdcf {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:57:43 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:43 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf 1073741824 Sep 05 04:57:43 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:43 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf 1073741824" returned: 0 in 0.409s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:44 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf Sep 05 04:57:44 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:44 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf" returned: 0 in 0.241s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0caa7a2f-5b54-4778-8eb8-ad8937575845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5692db2a-dd0e-42cf-84b9-bf20cb7ff46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:44 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Volume volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf (e8659b3c-e208-4ef8-9b84-90f1271dfdcf): created successfully Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5692db2a-dd0e-42cf-84b9-bf20cb7ff46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Flow 'volume_create_manager' (61063234-9bff-4be6-8c62-ac336bf9dac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:57:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ffbe81d5-5d65-47f8-ac8f-796805f73d54 tempest-ProjectReaderTests-1180738628 None] Created volume successfully. Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Acquiring lock "cinder-e8659b3c-e208-4ef8-9b84-90f1271dfdcf-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Lock "cinder-e8659b3c-e208-4ef8-9b84-90f1271dfdcf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Acquiring lock "cinder-quobyte-e8659b3c-e208-4ef8-9b84-90f1271dfdcf" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Lock "cinder-quobyte-e8659b3c-e208-4ef8-9b84-90f1271dfdcf" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb5721a-01b0-478c-bcc7-8b1fbb88abf4]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:44 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf Sep 05 04:57:44 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:44 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf" returned: 0 in 0.358s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:44 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf Sep 05 04:57:44 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:45 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e8659b3c-e208-4ef8-9b84-90f1271dfdcf" returned: 0 in 0.249s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Lock "cinder-quobyte-e8659b3c-e208-4ef8-9b84-90f1271dfdcf" released by "delete_volume" :: held 0.641s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Created reservations ['cc81c4a3-96f8-4d3f-91ec-ebd3852581b0', 'a891ae78-9a1d-4cc7-b2a7-4848603761e6', '1bdef127-e83d-4af1-bc23-0b65f37e4985', 'f1ca60c6-657e-47d0-a1b6-346d1a773e96'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:45 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:57:45 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:45 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.245s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:57:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Deleted volume successfully. Sep 05 04:57:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-025ede74-c777-41d1-b8a3-a6b50e0c265f tempest-ProjectReaderTests-1180738628 None] Lock "cinder-e8659b3c-e208-4ef8-9b84-90f1271dfdcf-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:57:55 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=14,cinder:UPDATE=24,cinder:INSERT=4 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:57:55 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=20,cinder:SELECT=14,cinder:INSERT=6,cinder:DELETE=4 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (8c5c864b-360b-4849-89de-9653a4cde2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402882d7-2b62-4848-a0e7-d35ca7f33e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402882d7-2b62-4848-a0e7-d35ca7f33e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418878037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800423b6-351e-41fd-8cec-0639b7e26095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:57:58Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f7fc92-c87b-41dd-b99f-d383760a443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f7fc92-c87b-41dd-b99f-d383760a443c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a865e7-16bb-466b-b356-016ebf78595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a865e7-16bb-466b-b356-016ebf78595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800423b6-351e-41fd-8cec-0639b7e26095', 'volume_name': 'volume-800423b6-351e-41fd-8cec-0639b7e26095', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc45e91-cb0d-4508-a2cc-459579445d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc45e91-cb0d-4508-a2cc-459579445d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ead16b-2cdd-4e18-a6d6-eff72bac9c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:57 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume 800423b6-351e-41fd-8cec-0639b7e26095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800423b6-351e-41fd-8cec-0639b7e26095', 'volume_size': 1} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418878037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800423b6-351e-41fd-8cec-0639b7e26095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:57:58Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Creating volume 800423b6-351e-41fd-8cec-0639b7e26095 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:57:57 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:57 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095 1073741824 Sep 05 04:57:57 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Flow 'volume_create_manager' (219f163b-9cbb-4a6d-9bde-c85fbc0f2129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef3f3a0-8804-47d2-a037-7ed4451e3965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef3f3a0-8804-47d2-a037-7ed4451e3965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1574010112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f737bf6-56c5-45f9-9940-5f218a8066ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9868d104c4604635b501cac824e1aeae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:57:58Z,use_quota=True,user_id='8a12553c88ff47f38c4573d7d63fbf69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde2b220-f884-4d2c-96c4-141510a16f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde2b220-f884-4d2c-96c4-141510a16f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e742df78-6e8d-41bd-97d7-a239328ea8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e742df78-6e8d-41bd-97d7-a239328ea8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f737bf6-56c5-45f9-9940-5f218a8066ec', 'volume_name': 'volume-6f737bf6-56c5-45f9-9940-5f218a8066ec', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6045401-7177-45b9-b3d5-165f24c8826b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6045401-7177-45b9-b3d5-165f24c8826b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd57b7a-5f45-4e12-816d-f0142daf2e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:57 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Volume 6f737bf6-56c5-45f9-9940-5f218a8066ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f737bf6-56c5-45f9-9940-5f218a8066ec', 'volume_size': 1} Sep 05 04:57:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:58 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095 1073741824" returned: 0 in 0.569s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:58 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095 Sep 05 04:57:58 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:58 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095" returned: 0 in 0.269s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.694s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1574010112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f737bf6-56c5-45f9-9940-5f218a8066ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9868d104c4604635b501cac824e1aeae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:57:58Z,use_quota=True,user_id='8a12553c88ff47f38c4573d7d63fbf69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Creating volume 6f737bf6-56c5-45f9-9940-5f218a8066ec {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:57:58 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:58 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec 1073741824 Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ead16b-2cdd-4e18-a6d6-eff72bac9c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800423b6-351e-41fd-8cec-0639b7e26095', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:58 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ece41ec-d249-420c-9c99-da2c6647ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:58 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume volume-800423b6-351e-41fd-8cec-0639b7e26095 (800423b6-351e-41fd-8cec-0639b7e26095): created successfully Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ece41ec-d249-420c-9c99-da2c6647ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:58 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (8c5c864b-360b-4849-89de-9653a4cde2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:57:58 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b02554ff-471e-4c20-b928-3d867ed804cd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created volume successfully. Sep 05 04:57:59 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec 1073741824" returned: 0 in 0.488s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:57:59 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec Sep 05 04:57:59 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:57:59 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Sep 05 04:57:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec" returned: 0 in 0.287s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:57:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:57:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:57:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd57b7a-5f45-4e12-816d-f0142daf2e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f737bf6-56c5-45f9-9940-5f218a8066ec', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59685a0f-b729-461f-adf0-3df2ee6703e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:57:59 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Volume volume-6f737bf6-56c5-45f9-9940-5f218a8066ec (6f737bf6-56c5-45f9-9940-5f218a8066ec): created successfully Sep 05 04:57:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59685a0f-b729-461f-adf0-3df2ee6703e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:57:59 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Flow 'volume_create_manager' (219f163b-9cbb-4a6d-9bde-c85fbc0f2129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:57:59 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e8c8a881-f93b-4efa-8258-9be260fc5a94 tempest-VolumeDependencyTests-1374403442 None] Created volume successfully. Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (7b27f0ac-7704-4f17-a5c5-7de9f5d306cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8b6e8d-56ed-42cd-9c3a-1befd1ef15c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8b6e8d-56ed-42cd-9c3a-1befd1ef15c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164845111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b087297a-f8c5-424a-94cd-74c97e06277b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:00Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d39f1f-b2ec-4b6e-a340-d43302a00734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d39f1f-b2ec-4b6e-a340-d43302a00734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6be4d0-7085-4590-a977-da65c45a1ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6be4d0-7085-4590-a977-da65c45a1ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b087297a-f8c5-424a-94cd-74c97e06277b', 'volume_name': 'volume-b087297a-f8c5-424a-94cd-74c97e06277b', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541995ff-7f40-4bc1-9629-8a907202e3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541995ff-7f40-4bc1-9629-8a907202e3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7cff7ea-841d-4f9f-a0e2-a843d58034cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:00 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume b087297a-f8c5-424a-94cd-74c97e06277b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b087297a-f8c5-424a-94cd-74c97e06277b', 'volume_size': 1} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164845111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b087297a-f8c5-424a-94cd-74c97e06277b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:00Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Creating volume b087297a-f8c5-424a-94cd-74c97e06277b {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:00 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:00 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b 1073741824 Sep 05 04:58:00 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Flow 'volume_create_manager' (8bbd1075-dd33-4a7f-a5e3-831b83a41bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961352cf-b5fd-4ed0-9e8e-bd06ba114d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961352cf-b5fd-4ed0-9e8e-bd06ba114d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7819a29-0785-449c-a7e1-2a5198788426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6312b308c140019d08e13b509f975e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:01Z,use_quota=True,user_id='042b2c34e2a649eeb01b37b2cc295402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fda314-7493-44ff-a22e-98f189c9dfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fda314-7493-44ff-a22e-98f189c9dfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46bb823-cc56-41dd-bd00-47f8e574a840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.image.glance [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Creating Keystone auth plugin from conf {{(pid=89807) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 04:58:00 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (bcdc5847-ea22-43c6-a34d-f7f4f20edf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0dd705-cc21-4ee4-8ad8-3ea719445e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0dd705-cc21-4ee4-8ad8-3ea719445e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-280971340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653c5076-ee48-431c-a2f7-c719da2d0f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:01Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad6c148-457f-4c4e-9df4-c0baf256232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad6c148-457f-4c4e-9df4-c0baf256232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271fe4a7-78d1-42ee-9b71-137bc059910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271fe4a7-78d1-42ee-9b71-137bc059910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653c5076-ee48-431c-a2f7-c719da2d0f7f', 'volume_name': 'volume-653c5076-ee48-431c-a2f7-c719da2d0f7f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dd0fd3-dad3-4ab5-b491-4dc78f19dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dd0fd3-dad3-4ab5-b491-4dc78f19dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70169cab-eada-4060-bf6a-a07f756fcea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume 653c5076-ee48-431c-a2f7-c719da2d0f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653c5076-ee48-431c-a2f7-c719da2d0f7f', 'volume_size': 1} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (e4349bfb-800f-4ed5-9a7c-1f66f503176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f15a2b-9a6e-404a-ba65-4bcf09f53606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f15a2b-9a6e-404a-ba65-4bcf09f53606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1390671459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8371637f-4e32-413c-877f-f6cd729adc1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:01Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ee9f9d-9667-4f1a-b59e-93ab5b10c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ee9f9d-9667-4f1a-b59e-93ab5b10c516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad879c2-ddf3-45ef-b2b7-3dd08acd7e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad879c2-ddf3-45ef-b2b7-3dd08acd7e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8371637f-4e32-413c-877f-f6cd729adc1c', 'volume_name': 'volume-8371637f-4e32-413c-877f-f6cd729adc1c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa96ba13-15e1-454b-b5f9-a764f75a323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa96ba13-15e1-454b-b5f9-a764f75a323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b898e144-1f63-4ff4-98de-7a5843584ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume 8371637f-4e32-413c-877f-f6cd729adc1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8371637f-4e32-413c-877f-f6cd729adc1c', 'volume_size': 1} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46bb823-cc56-41dd-bd00-47f8e574a840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7819a29-0785-449c-a7e1-2a5198788426', 'volume_name': 'volume-b7819a29-0785-449c-a7e1-2a5198788426', 'volume_size': 1, 'image_id': '939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5bf7e89ced9160f3429b3b5562659f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a6312b308c140019d08e13b509f975e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce61a40cad628648c85ae15aeb5b604037f0898781324ac31a6b7a981abe595995f9a4718cae234f4426d0a30f97274610ba04d6ba9be90739715406da3025c3', 'id': '939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'created_at': datetime.datetime(2026, 9, 5, 2, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/939a9100-1087-4ad1-a2ca-88cbd20d0e46/file', 'properties': {}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4490b9af-863a-4e7a-beb8-1f8309d2b52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4490b9af-863a-4e7a-beb8-1f8309d2b52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d4c98c-eb57-4fec-98d9-956ae6a3181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Volume b7819a29-0785-449c-a7e1-2a5198788426: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7819a29-0785-449c-a7e1-2a5198788426', 'volume_size': 1, 'image_id': '939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5bf7e89ced9160f3429b3b5562659f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a6312b308c140019d08e13b509f975e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce61a40cad628648c85ae15aeb5b604037f0898781324ac31a6b7a981abe595995f9a4718cae234f4426d0a30f97274610ba04d6ba9be90739715406da3025c3', 'id': '939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'created_at': datetime.datetime(2026, 9, 5, 2, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/939a9100-1087-4ad1-a2ca-88cbd20d0e46/file', 'properties': {}}, 'image_service': } Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Trying to clone b7819a29-0785-449c-a7e1-2a5198788426 from image 939a9100-1087-4ad1-a2ca-88cbd20d0e46 at location (None, [{'url': 'file:///opt/stack/data/glance/images/939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'metadata': {}}]). {{(pid=89807) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 04:58:01 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b 1073741824" returned: 0 in 0.735s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:01 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b Sep 05 04:58:01 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (dde6f177-c362-47a9-af0e-0f2418266a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f3b4fb-9a01-4ec7-9b32-c350a28a926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 04:58:01 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Image download 0.00 MB at 0.00 MB/s Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f3b4fb-9a01-4ec7-9b32-c350a28a926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2103887805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce014d2-796c-4be8-b135-3c344c74c790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:02Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d061b201-10d2-4649-839f-407573a515e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d061b201-10d2-4649-839f-407573a515e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96adeaba-5b23-426f-9636-b193cc575a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96adeaba-5b23-426f-9636-b193cc575a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce014d2-796c-4be8-b135-3c344c74c790', 'volume_name': 'volume-0ce014d2-796c-4be8-b135-3c344c74c790', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166e6e2b-814c-4814-81e5-0b7ab05419ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166e6e2b-814c-4814-81e5-0b7ab05419ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0257afb8-f617-4985-803f-bc2c328094d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:01 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume 0ce014d2-796c-4be8-b135-3c344c74c790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce014d2-796c-4be8-b135-3c344c74c790', 'volume_size': 1} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e70977c-f78e-4f98-8237-9a6d8117d17f]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:01 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b" returned: 0 in 0.369s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.076s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:01 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD Sep 05 04:58:01 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Creating offline snapshot 9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 of volume 6f737bf6-56c5-45f9-9940-5f218a8066ec {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7cff7ea-841d-4f9f-a0e2-a843d58034cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b087297a-f8c5-424a-94cd-74c97e06277b', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73366a50-8147-4de4-af71-692bc4c6839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea483e4-ad06-4cef-bd25-299a6344a7fa]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:02 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume volume-b087297a-f8c5-424a-94cd-74c97e06277b (b087297a-f8c5-424a-94cd-74c97e06277b): created successfully Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73366a50-8147-4de4-af71-692bc4c6839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (7b27f0ac-7704-4f17-a5c5-7de9f5d306cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:02 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b443dd59-7a69-4ae8-a053-1a2002509a62 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created volume successfully. Sep 05 04:58:02 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec Sep 05 04:58:02 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:02 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD" returned: 0 in 0.472s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:02 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD Sep 05 04:58:02 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:02 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec" returned: 0 in 0.461s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:02 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 1G Sep 05 04:58:02 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Flow 'volume_create_manager' (e6c5195e-eb33-4629-ac02-faa7a3f975b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3713dbfe-81e8-4445-92f8-6c09ace45963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3713dbfe-81e8-4445-92f8-6c09ace45963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6d2572-763b-48b4-8449-59b01393d48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda573bd91f84a5a805797d32407cdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:02Z,use_quota=True,user_id='52abb021b4e3418090bffa4012c164d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49e5bc81-fdb8-498e-809e-127ccbb29664),volume_type_id=49e5bc81-fdb8-498e-809e-127ccbb29664)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a15184b-98d0-4034-92ab-58db1593b11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a15184b-98d0-4034-92ab-58db1593b11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b2343d-356c-4778-85c0-56afd873384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.image.glance [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Creating Keystone auth plugin from conf {{(pid=89807) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (bc80bb8e-9b60-4271-84a8-de9a14437aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3f0d7f-b4d5-4e8e-ab31-903f6bfc2e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3f0d7f-b4d5-4e8e-ab31-903f6bfc2e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-258944233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccade72d-605d-4151-97a5-9c904f654314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:02Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb94cd5-50aa-4fb6-ac58-97b195f9fd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb94cd5-50aa-4fb6-ac58-97b195f9fd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91b3f8c-4bef-41f6-8081-8706edf52787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91b3f8c-4bef-41f6-8081-8706edf52787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccade72d-605d-4151-97a5-9c904f654314', 'volume_name': 'volume-ccade72d-605d-4151-97a5-9c904f654314', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384bba8d-c3dd-4ab5-8f58-26752e260de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384bba8d-c3dd-4ab5-8f58-26752e260de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b7e8a4-1f01-4c6e-ad89-8dc7f1ec24df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume ccade72d-605d-4151-97a5-9c904f654314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccade72d-605d-4151-97a5-9c904f654314', 'volume_size': 1} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD" returned: 1 in 0.437s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Temporary image 939a9100-1087-4ad1-a2ca-88cbd20d0e46 is fetched for user 042b2c34e2a649eeb01b37b2cc295402. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e90ecd-7ddc-435b-bb4e-fc8454510fae]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b2343d-356c-4778-85c0-56afd873384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac6d2572-763b-48b4-8449-59b01393d48a', 'volume_name': 'volume-ac6d2572-763b-48b4-8449-59b01393d48a', 'volume_size': 1, 'image_id': '870786f9-a877-4442-8530-fa84a0fe8b8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/870786f9-a877-4442-8530-fa84a0fe8b8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '549947e43571d92cb95b9c298a623808', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dda573bd91f84a5a805797d32407cdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6febc4a510ddf029a1e1f7dac78c77539ec0bb9977b37fd78e045319fbb217272dae3016f9037a1e0883239e228923c88955ddeca4f3d69630557de9ce09d0e', 'id': '870786f9-a877-4442-8530-fa84a0fe8b8b', 'created_at': datetime.datetime(2026, 9, 5, 2, 57, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870786f9-a877-4442-8530-fa84a0fe8b8b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063d20d5-4f8e-4adb-b421-8f306cf37b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063d20d5-4f8e-4adb-b421-8f306cf37b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b02ceb-80c8-411d-898f-a8305b07fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:02 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Volume ac6d2572-763b-48b4-8449-59b01393d48a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac6d2572-763b-48b4-8449-59b01393d48a', 'volume_size': 1, 'image_id': '870786f9-a877-4442-8530-fa84a0fe8b8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/870786f9-a877-4442-8530-fa84a0fe8b8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '549947e43571d92cb95b9c298a623808', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dda573bd91f84a5a805797d32407cdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6febc4a510ddf029a1e1f7dac78c77539ec0bb9977b37fd78e045319fbb217272dae3016f9037a1e0883239e228923c88955ddeca4f3d69630557de9ce09d0e', 'id': '870786f9-a877-4442-8530-fa84a0fe8b8b', 'created_at': datetime.datetime(2026, 9, 5, 2, 57, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870786f9-a877-4442-8530-fa84a0fe8b8b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Trying to clone ac6d2572-763b-48b4-8449-59b01393d48a from image 870786f9-a877-4442-8530-fa84a0fe8b8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/870786f9-a877-4442-8530-fa84a0fe8b8b', 'metadata': {}}]). {{(pid=89807) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 04:58:02 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD Sep 05 04:58:02 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:02 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 1G" returned: 0 in 0.480s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f737bf6-56c5-45f9-9940-5f218a8066ec -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:03 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f737bf6-56c5-45f9-9940-5f218a8066ec -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 Sep 05 04:58:03 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 04:58:03 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Image download 0.00 MB at 0.00 MB/s Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7957a7-d9b2-4b20-b2a8-d573d061af3a]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:03 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:03 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD Sep 05 04:58:03 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:03 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD Sep 05 04:58:03 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:03 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f737bf6-56c5-45f9-9940-5f218a8066ec -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742" returned: 0 in 0.373s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:03 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 is being set with open permissions: ugo+rw Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:03 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 Sep 05 04:58:03 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:03 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:03 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD" returned: 1 in 0.369s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:03 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD Sep 05 04:58:03 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:03 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742" returned: 0 in 0.267s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:03 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.info Sep 05 04:58:03 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:03 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Temporary image 870786f9-a877-4442-8530-fa84a0fe8b8b is fetched for user 52abb021b4e3418090bffa4012c164d1. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 04:58:03 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.info" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:03 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.info is being set with open permissions: ugo+rw Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdd0a42-fd08-46f7-b1ca-4e475430b494]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:03 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.info Sep 05 04:58:03 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:04 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD Sep 05 04:58:04 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:04 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.info" returned: 0 in 0.270s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.059s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-280971340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653c5076-ee48-431c-a2f7-c719da2d0f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:01Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Creating volume 653c5076-ee48-431c-a2f7-c719da2d0f7f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:04 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:04 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f 1073741824 Sep 05 04:58:04 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:04 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:04 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-eea9a823-498c-4faa-acaa-ddb7b7e72ac4 tempest-VolumeDependencyTests-1374403442 None] Create snapshot completed successfully Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:04 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD Sep 05 04:58:04 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:04 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:04 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f 1073741824" returned: 0 in 0.428s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:04 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f Sep 05 04:58:04 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:04 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f" returned: 0 in 0.240s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.527s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1390671459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8371637f-4e32-413c-877f-f6cd729adc1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:01Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Creating volume 8371637f-4e32-413c-877f-f6cd729adc1c {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:04 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70169cab-eada-4060-bf6a-a07f756fcea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653c5076-ee48-431c-a2f7-c719da2d0f7f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:04 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c 1073741824 Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f85c810-25ee-49c8-9340-ae54ef016160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:04 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:04 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume volume-653c5076-ee48-431c-a2f7-c719da2d0f7f (653c5076-ee48-431c-a2f7-c719da2d0f7f): created successfully Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f85c810-25ee-49c8-9340-ae54ef016160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:04 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (bcdc5847-ea22-43c6-a34d-f7f4f20edf42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-53d4ee07-1136-48bf-97a6-ed4e7e54f6e6 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created volume successfully. Sep 05 04:58:05 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c 1073741824" returned: 0 in 0.464s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:05 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c Sep 05 04:58:05 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Flow 'volume_create_manager' (088fc6c5-b615-45bb-b046-37d26751506f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f45409d-343d-4843-ad83-fb3f0b894a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f45409d-343d-4843-ad83-fb3f0b894a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-385065602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d0d562-3fff-488a-a102-d5c0471898de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9868d104c4604635b501cac824e1aeae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9cf4fcc0-b053-4cca-8f53-2a0bc88a1742,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:06Z,use_quota=True,user_id='8a12553c88ff47f38c4573d7d63fbf69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:05 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787ed98f-ea09-4d5e-9008-91e89cb62668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787ed98f-ea09-4d5e-9008-91e89cb62668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7150c474-09ad-486a-b60e-1915253d93ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7150c474-09ad-486a-b60e-1915253d93ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40d0d562-3fff-488a-a102-d5c0471898de', 'volume_name': 'volume-40d0d562-3fff-488a-a102-d5c0471898de', 'volume_size': 1, 'snapshot_id': '9cf4fcc0-b053-4cca-8f53-2a0bc88a1742'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe7239d-8eb1-4e5f-99de-09843014f136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe7239d-8eb1-4e5f-99de-09843014f136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b06e93e-8d2c-4399-9f87-12812a3ff7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:05 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Volume 40d0d562-3fff-488a-a102-d5c0471898de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40d0d562-3fff-488a-a102-d5c0471898de', 'volume_size': 1, 'snapshot_id': '9cf4fcc0-b053-4cca-8f53-2a0bc88a1742'} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c" returned: 0 in 0.303s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.978s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2103887805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce014d2-796c-4be8-b135-3c344c74c790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:02Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Creating volume 0ce014d2-796c-4be8-b135-3c344c74c790 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:05 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:05 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790 1073741824 Sep 05 04:58:05 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b898e144-1f63-4ff4-98de-7a5843584ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8371637f-4e32-413c-877f-f6cd729adc1c', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417e240b-b10a-4e17-bbaf-0978c7b10a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:05 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume volume-8371637f-4e32-413c-877f-f6cd729adc1c (8371637f-4e32-413c-877f-f6cd729adc1c): created successfully Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417e240b-b10a-4e17-bbaf-0978c7b10a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (e4349bfb-800f-4ed5-9a7c-1f66f503176e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d35e0eb1-e3fc-4e7d-a0a8-771a6488359d tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created volume successfully. Sep 05 04:58:06 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790 1073741824" returned: 0 in 0.432s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:06 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790 Sep 05 04:58:06 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:06 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790" returned: 0 in 0.246s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.758s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-258944233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccade72d-605d-4151-97a5-9c904f654314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a6fe409c64e1f8ba29874ad7ca48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:02Z,use_quota=True,user_id='07c8fdefe9e24321bc4df3b5c2247371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Creating volume ccade72d-605d-4151-97a5-9c904f654314 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:06 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0257afb8-f617-4985-803f-bc2c328094d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce014d2-796c-4be8-b135-3c344c74c790', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ebd945-4145-4aba-92ef-3fea59ae07df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:06 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314 1073741824 Sep 05 04:58:06 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:06 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume volume-0ce014d2-796c-4be8-b135-3c344c74c790 (0ce014d2-796c-4be8-b135-3c344c74c790): created successfully Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ebd945-4145-4aba-92ef-3fea59ae07df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (dde6f177-c362-47a9-af0e-0f2418266a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-607e22f8-a99e-4d85-9cfe-1bdea2ea257b tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created volume successfully. Sep 05 04:58:06 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314 1073741824" returned: 0 in 0.417s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:06 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314 Sep 05 04:58:06 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:07 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314" returned: 0 in 0.242s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.623s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7819a29-0785-449c-a7e1-2a5198788426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6312b308c140019d08e13b509f975e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:01Z,use_quota=True,user_id='042b2c34e2a649eeb01b37b2cc295402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Creating volume b7819a29-0785-449c-a7e1-2a5198788426 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:07 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b7e8a4-1f01-4c6e-ad89-8dc7f1ec24df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccade72d-605d-4151-97a5-9c904f654314', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:07 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 1073741824 Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5676070-8f21-4037-82fe-ad9ec7b547c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:07 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:07 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Volume volume-ccade72d-605d-4151-97a5-9c904f654314 (ccade72d-605d-4151-97a5-9c904f654314): created successfully Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5676070-8f21-4037-82fe-ad9ec7b547c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Flow 'volume_create_manager' (bc80bb8e-9b60-4271-84a8-de9a14437aa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:07 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-82a981cf-8213-4352-8c90-a0e50c1fb997 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created volume successfully. Sep 05 04:58:07 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 1073741824" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:07 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 Sep 05 04:58:07 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:07 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426" returned: 0 in 0.275s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.247s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6d2572-763b-48b4-8449-59b01393d48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda573bd91f84a5a805797d32407cdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:02Z,use_quota=True,user_id='52abb021b4e3418090bffa4012c164d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49e5bc81-fdb8-498e-809e-127ccbb29664),volume_type_id=49e5bc81-fdb8-498e-809e-127ccbb29664)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Creating volume ac6d2572-763b-48b4-8449-59b01393d48a {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:07 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-ccade72d-605d-4151-97a5-9c904f654314-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:07 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a 1073741824 Sep 05 04:58:07 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-ccade72d-605d-4151-97a5-9c904f654314-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:07 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Attempting download of 939a9100-1087-4ad1-a2ca-88cbd20d0e46 ((None, [{'url': 'file:///opt/stack/data/glance/images/939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'metadata': {}}])) to volume b7819a29-0785-449c-a7e1-2a5198788426. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-quobyte-ccade72d-605d-4151-97a5-9c904f654314" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd1b96c-7f59-44ca-81bd-c3e3dc5937d3]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-ccade72d-605d-4151-97a5-9c904f654314" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_939a9100-1087-4ad1-a2ca-88cbd20d0e46_b2nhg10e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[916a30bb-9058-4218-832c-b71f81555274]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:08 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_939a9100-1087-4ad1-a2ca-88cbd20d0e46_b2nhg10e Sep 05 04:58:08 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:08 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314 Sep 05 04:58:08 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:08 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a 1073741824" returned: 0 in 0.500s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:08 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_939a9100-1087-4ad1-a2ca-88cbd20d0e46_b2nhg10e" returned: 0 in 0.378s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_939a9100-1087-4ad1-a2ca-88cbd20d0e46_b2nhg10e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:08 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314" returned: 0 in 0.428s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:08 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a Sep 05 04:58:08 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:08 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314 Sep 05 04:58:08 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:08 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_939a9100-1087-4ad1-a2ca-88cbd20d0e46_b2nhg10e Sep 05 04:58:08 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:08 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a" returned: 0 in 0.270s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.983s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "cinder-quobyte-9cf4fcc0-b053-4cca-8f53-2a0bc88a1742-40d0d562-3fff-488a-a102-d5c0471898de" by "_create_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:08 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-9cf4fcc0-b053-4cca-8f53-2a0bc88a1742-40d0d562-3fff-488a-a102-d5c0471898de" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Creating volume 40d0d562-3fff-488a-a102-d5c0471898de from snapshot 9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 {{(pid=89807) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "cinder-quobyte-40d0d562-3fff-488a-a102-d5c0471898de" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:08 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ccade72d-605d-4151-97a5-9c904f654314" returned: 0 in 0.307s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_939a9100-1087-4ad1-a2ca-88cbd20d0e46_b2nhg10e" returned: 1 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_939a9100-1087-4ad1-a2ca-88cbd20d0e46_b2nhg10e' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Attempting download of 870786f9-a877-4442-8530-fa84a0fe8b8b ((None, [{'url': 'file:///opt/stack/data/glance/images/870786f9-a877-4442-8530-fa84a0fe8b8b', 'metadata': {}}])) to volume ac6d2572-763b-48b4-8449-59b01393d48a. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a66569-5e1b-4b7e-89de-6a35bb0cf3f8]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-40d0d562-3fff-488a-a102-d5c0471898de" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] snapshot: 9cf4fcc0-b053-4cca-8f53-2a0bc88a1742, volume: 40d0d562-3fff-488a-a102-d5c0471898de, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-ccade72d-605d-4151-97a5-9c904f654314" released by "delete_volume" :: held 0.807s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e665d6c6-9940-40f0-a629-aa0bd697b926]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870786f9-a877-4442-8530-fa84a0fe8b8b_vce09p__ {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[332367bc-fe10-4d48-b231-d42f8376fa18]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:08 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD Sep 05 04:58:08 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created reservations ['c868e67d-8bce-40a9-99e4-bdad83be72ec', 'c6ce6126-2565-48c4-b04f-51d17b0de241', '4e3bf9bd-613e-437f-a5ec-e19f16151bf3', 'ce486500-5215-427e-bcd1-9be5d1cc41be'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:09 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870786f9-a877-4442-8530-fa84a0fe8b8b_vce09p__ Sep 05 04:58:09 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:09 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 Sep 05 04:58:09 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:09 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:09 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:09 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:09 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD Sep 05 04:58:09 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:09 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870786f9-a877-4442-8530-fa84a0fe8b8b_vce09p__" returned: 0 in 0.396s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870786f9-a877-4442-8530-fa84a0fe8b8b_vce09p__ {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:09 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:09 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870786f9-a877-4442-8530-fa84a0fe8b8b_vce09p__ Sep 05 04:58:09 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:09 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.281s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742" returned: 0 in 0.520s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f737bf6-56c5-45f9-9940-5f218a8066ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:58:09 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Deleted volume successfully. Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[474ab0d1-15ca-401b-98f1-25d6544369bd]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d4684950-949d-4570-8f0b-0ad7a358927f tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-ccade72d-605d-4151-97a5-9c904f654314-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:09 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD" returned: 1 in 0.421s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] 939a9100-1087-4ad1-a2ca-88cbd20d0e46 was raw, converting to qcow2 {{(pid=89807) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:09 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec Sep 05 04:58:09 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:09 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 Sep 05 04:58:09 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:09 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870786f9-a877-4442-8530-fa84a0fe8b8b_vce09p__" returned: 1 in 0.388s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870786f9-a877-4442-8530-fa84a0fe8b8b_vce09p__' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c764b4f8-22b2-4f81-9a83-c1dd1816d5e1]: (4, 'raw') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:09 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD Sep 05 04:58:09 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:10 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec" returned: 0 in 0.532s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:10 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de Sep 05 04:58:10 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:10 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:10 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-0ce014d2-796c-4be8-b135-3c344c74c790-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426" returned: 0 in 0.581s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_939a9100-1087-4ad1-a2ca-88cbd20d0e46_m_nk64q0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:58:10 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-0ce014d2-796c-4be8-b135-3c344c74c790-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:10 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 1G Sep 05 04:58:10 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-quobyte-0ce014d2-796c-4be8-b135-3c344c74c790" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-0ce014d2-796c-4be8-b135-3c344c74c790" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:10 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD Sep 05 04:58:10 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a950af33-6508-4c2c-9a57-c4bdc6261aab]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:10 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790 Sep 05 04:58:10 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:10 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] 870786f9-a877-4442-8530-fa84a0fe8b8b was raw, converting to qcow2 {{(pid=89807) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:10 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a Sep 05 04:58:10 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:10 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 1G" returned: 0 in 0.637s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Downloaded image 939a9100-1087-4ad1-a2ca-88cbd20d0e46 ((None, [{'url': 'file:///opt/stack/data/glance/images/939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'metadata': {}}])) to volume b7819a29-0785-449c-a7e1-2a5198788426 successfully. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Temporary image 939a9100-1087-4ad1-a2ca-88cbd20d0e46 for user 042b2c34e2a649eeb01b37b2cc295402 is deleted. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Marking volume b7819a29-0785-449c-a7e1-2a5198788426 as bootable. {{(pid=89807) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Copying metadata from image 939a9100-1087-4ad1-a2ca-88cbd20d0e46 to b7819a29-0785-449c-a7e1-2a5198788426. {{(pid=89807) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 04:58:10 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Creating volume glance metadata for volume b7819a29-0785-449c-a7e1-2a5198788426 backed by image 939a9100-1087-4ad1-a2ca-88cbd20d0e46 with: {'image_id': '939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e5bf7e89ced9160f3429b3b5562659f0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89807) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 04:58:10 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:10 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:11 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d4c98c-eb57-4fec-98d9-956ae6a3181b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7819a29-0785-449c-a7e1-2a5198788426', 'volume_size': 1, 'image_id': '939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5bf7e89ced9160f3429b3b5562659f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a6312b308c140019d08e13b509f975e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce61a40cad628648c85ae15aeb5b604037f0898781324ac31a6b7a981abe595995f9a4718cae234f4426d0a30f97274610ba04d6ba9be90739715406da3025c3', 'id': '939a9100-1087-4ad1-a2ca-88cbd20d0e46', 'created_at': datetime.datetime(2026, 9, 5, 2, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/939a9100-1087-4ad1-a2ca-88cbd20d0e46/file', 'properties': {}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a47ac7-74d7-45ec-a423-c4eb0d85bbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790" returned: 0 in 0.758s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:11 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Volume volume-b7819a29-0785-449c-a7e1-2a5198788426 (b7819a29-0785-449c-a7e1-2a5198788426): created successfully Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a47ac7-74d7-45ec-a423-c4eb0d85bbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:11 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790 Sep 05 04:58:11 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Flow 'volume_create_manager' (8bbd1075-dd33-4a7f-a5e3-831b83a41bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:11 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8d245323-1842-44d8-9ecb-6dd0262df8c3 tempest-VolumeImageDependencyTests-140659259 None] Created volume successfully. Sep 05 04:58:11 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.637s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:58:11 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0ce014d2-796c-4be8-b135-3c344c74c790" returned: 0 in 0.621s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-0ce014d2-796c-4be8-b135-3c344c74c790" released by "delete_volume" :: held 1.451s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:11 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created reservations ['0b701057-3c4f-4cba-a67e-bb7709a1d740', 'a1ba5c60-2a6a-4a3f-9c39-28bef5d3353b', '23b6a878-526d-42db-9d54-fe8772c9517c', 'e9de3828-0f75-4e6d-9c6d-711c6b4e903c'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:12 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Acquiring lock "cinder-b7819a29-0785-449c-a7e1-2a5198788426-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a" returned: 0 in 1.380s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_870786f9-a877-4442-8530-fa84a0fe8b8b_izw3svtpdevstack@QuobyteHD, size 0.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:58:12 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:12 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a 1G Sep 05 04:58:12 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Lock "cinder-b7819a29-0785-449c-a7e1-2a5198788426-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Acquiring lock "cinder-quobyte-b7819a29-0785-449c-a7e1-2a5198788426" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Lock "cinder-quobyte-b7819a29-0785-449c-a7e1-2a5198788426" acquired by "delete_volume" :: waited 0.050s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:12 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:12 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e9f489-fa65-4d8d-82dc-6fdb392666a9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-8371637f-4e32-413c-877f-f6cd729adc1c-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-8371637f-4e32-413c-877f-f6cd729adc1c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-quobyte-8371637f-4e32-413c-877f-f6cd729adc1c" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-8371637f-4e32-413c-877f-f6cd729adc1c" acquired by "delete_volume" :: waited 0.088s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:13 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 Sep 05 04:58:13 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[325effe2-44c1-4821-94e5-8f72acca5a6e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:13 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:13 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a 1G" returned: 0 in 1.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Downloaded image 870786f9-a877-4442-8530-fa84a0fe8b8b ((None, [{'url': 'file:///opt/stack/data/glance/images/870786f9-a877-4442-8530-fa84a0fe8b8b', 'metadata': {}}])) to volume ac6d2572-763b-48b4-8449-59b01393d48a successfully. {{(pid=89807) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Temporary image 870786f9-a877-4442-8530-fa84a0fe8b8b for user 52abb021b4e3418090bffa4012c164d1 is deleted. {{(pid=89807) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.volume.volume_utils [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Marking volume ac6d2572-763b-48b4-8449-59b01393d48a as bootable. {{(pid=89807) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.985s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:13 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Deleted volume successfully. Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Copying metadata from image 870786f9-a877-4442-8530-fa84a0fe8b8b to ac6d2572-763b-48b4-8449-59b01393d48a. {{(pid=89807) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Creating volume glance metadata for volume ac6d2572-763b-48b4-8449-59b01393d48a backed by image 870786f9-a877-4442-8530-fa84a0fe8b8b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '870786f9-a877-4442-8530-fa84a0fe8b8b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '549947e43571d92cb95b9c298a623808', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89807) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-33fdf0d8-de87-4deb-91c7-4db56fc402bb tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-0ce014d2-796c-4be8-b135-3c344c74c790-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:13 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c Sep 05 04:58:13 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b02ceb-80c8-411d-898f-a8305b07fb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6d2572-763b-48b4-8449-59b01393d48a', 'volume_size': 1, 'image_id': '870786f9-a877-4442-8530-fa84a0fe8b8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/870786f9-a877-4442-8530-fa84a0fe8b8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '549947e43571d92cb95b9c298a623808', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dda573bd91f84a5a805797d32407cdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6febc4a510ddf029a1e1f7dac78c77539ec0bb9977b37fd78e045319fbb217272dae3016f9037a1e0883239e228923c88955ddeca4f3d69630557de9ce09d0e', 'id': '870786f9-a877-4442-8530-fa84a0fe8b8b', 'created_at': datetime.datetime(2026, 9, 5, 2, 57, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870786f9-a877-4442-8530-fa84a0fe8b8b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d636482c-9a47-484b-896e-54b5cd8be0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:13 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Volume volume-ac6d2572-763b-48b4-8449-59b01393d48a (ac6d2572-763b-48b4-8449-59b01393d48a): created successfully Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d636482c-9a47-484b-896e-54b5cd8be0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:13 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Flow 'volume_create_manager' (e6c5195e-eb33-4629-ac02-faa7a3f975b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:13 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-35657729-d433-4d47-ba57-4329e9243eae tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Created volume successfully. Sep 05 04:58:14 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426" returned: 0 in 1.580s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:14 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c" returned: 0 in 1.020s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:14 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426 Sep 05 04:58:14 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:14 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c Sep 05 04:58:14 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Acquiring lock "cinder-ac6d2572-763b-48b4-8449-59b01393d48a-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Lock "cinder-ac6d2572-763b-48b4-8449-59b01393d48a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Acquiring lock "cinder-quobyte-ac6d2572-763b-48b4-8449-59b01393d48a" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Lock "cinder-quobyte-ac6d2572-763b-48b4-8449-59b01393d48a" acquired by "delete_volume" :: waited 0.045s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cca558-2ea6-40bb-b4d8-3a9969096788]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:14 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b7819a29-0785-449c-a7e1-2a5198788426" returned: 0 in 0.578s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Lock "cinder-quobyte-b7819a29-0785-449c-a7e1-2a5198788426" released by "delete_volume" :: held 2.309s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:14 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a Sep 05 04:58:14 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:14 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Created reservations ['f8a08679-1a8a-481d-a409-1f1fb3d51188', '37bb4564-0bb7-4893-b533-ea28a390677a', 'd7c8428c-35f1-47d1-94ba-f3603e363485', 'b68d3582-d48a-4466-af67-f05dc3939589'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:15 devstack sudo[108879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:15 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:15 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-8371637f-4e32-413c-877f-f6cd729adc1c" returned: 0 in 1.301s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-8371637f-4e32-413c-877f-f6cd729adc1c" released by "delete_volume" :: held 2.503s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:15 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a" returned: 0 in 0.932s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:15 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a Sep 05 04:58:15 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:15 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.625s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:15 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Deleted volume successfully. Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created reservations ['6a23870f-56d7-48e5-bb7e-92cccf4f103a', '2f29bbf0-b55c-4b89-aac5-2784d28ba85e', '289c0ac5-cf5c-432e-83d5-d0ac844d9464', '2de0653e-286d-440e-bfd8-9e72c3889bf7'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:15 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-61738faa-cd14-4a7f-8101-6f2c151fd046 tempest-VolumeImageDependencyTests-140659259 None] Lock "cinder-b7819a29-0785-449c-a7e1-2a5198788426-delete_volume" released by "delete_volume" :: held 3.631s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:16 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-ac6d2572-763b-48b4-8449-59b01393d48a" returned: 0 in 0.651s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:16 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:16 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Lock "cinder-quobyte-ac6d2572-763b-48b4-8449-59b01393d48a" released by "delete_volume" :: held 1.705s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Created reservations ['37acc564-a0fa-43a8-905d-07f4260c394c', 'df002dbe-b48b-4cdd-ab71-e26746c59781', '3aa5d8b9-cddc-4277-b10a-a95e061ab089', '0f905ed7-d0b0-4abb-82d6-394fdcb22694'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:16 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de" returned: 0 in 6.401s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 04:58:16 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Converted 1024.00 MB image at 159.94 MB/s Sep 05 04:58:16 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de is being set with open permissions: ugo+rw Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:16 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de Sep 05 04:58:16 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-653c5076-ee48-431c-a2f7-c719da2d0f7f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-653c5076-ee48-431c-a2f7-c719da2d0f7f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:16 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:16 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-quobyte-653c5076-ee48-431c-a2f7-c719da2d0f7f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-653c5076-ee48-431c-a2f7-c719da2d0f7f" acquired by "delete_volume" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f246c1-7ee4-4ea6-8d5a-4b473f03b3e8]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:16 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.536s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:16 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Deleted volume successfully. Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-14eea93e-9cd1-4897-b39c-6f5d22fa6884 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-8371637f-4e32-413c-877f-f6cd729adc1c-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:16 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f Sep 05 04:58:16 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:16 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de" returned: 0 in 0.427s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-40d0d562-3fff-488a-a102-d5c0471898de" released by "_copy_volume_from_snapshot" :: held 8.036s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:16 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.343s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:16 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Deleted volume successfully. Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4e805833-a923-46be-ae1c-0e2325c9072a tempest-VolumeAndVolumeTypeFromImageTest-461605658 None] Lock "cinder-ac6d2572-763b-48b4-8449-59b01393d48a-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-9cf4fcc0-b053-4cca-8f53-2a0bc88a1742-40d0d562-3fff-488a-a102-d5c0471898de" released by "_create_volume_from_snapshot" :: held 8.195s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.222s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b06e93e-8d2c-4399-9f87-12812a3ff7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d0d562-3fff-488a-a102-d5c0471898de', 'volume_size': 1, 'snapshot_id': '9cf4fcc0-b053-4cca-8f53-2a0bc88a1742'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a9327a-44d6-4597-8431-28f13f520577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:17 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Volume volume-40d0d562-3fff-488a-a102-d5c0471898de (40d0d562-3fff-488a-a102-d5c0471898de): created successfully Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a9327a-44d6-4597-8431-28f13f520577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Flow 'volume_create_manager' (088fc6c5-b615-45bb-b046-37d26751506f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ead37901-317e-4d31-acae-e93e903982b7 tempest-VolumeDependencyTests-1374403442 None] Created volume successfully. Sep 05 04:58:17 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f" returned: 0 in 0.537s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:17 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f Sep 05 04:58:17 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:17 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-653c5076-ee48-431c-a2f7-c719da2d0f7f" returned: 0 in 0.275s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-653c5076-ee48-431c-a2f7-c719da2d0f7f" released by "delete_volume" :: held 0.873s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created reservations ['33708ba4-1bcb-4db8-91e8-238cb4ad46fd', 'd7356874-40ae-443b-b219-2a1c2d15ab2f', 'c32ddf72-cbce-4bb3-b80b-6c2b2472b525', '36d8e8fd-8d45-42f5-b486-9a2036335643'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:17 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:17 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-b087297a-f8c5-424a-94cd-74c97e06277b-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-b087297a-f8c5-424a-94cd-74c97e06277b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-quobyte-b087297a-f8c5-424a-94cd-74c97e06277b" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-b087297a-f8c5-424a-94cd-74c97e06277b" acquired by "delete_volume" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[da58444a-474d-4a8b-a519-fdf81ea00d60]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:18 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.348s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:18 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Deleted volume successfully. Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-413a602b-07cb-437b-a188-ceb5e56d6bcd tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-653c5076-ee48-431c-a2f7-c719da2d0f7f-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:18 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b Sep 05 04:58:18 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "cinder-9cf4fcc0-b053-4cca-8f53-2a0bc88a1742-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-9cf4fcc0-b053-4cca-8f53-2a0bc88a1742-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "cinder-quobyte-6f737bf6-56c5-45f9-9940-5f218a8066ec" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-6f737bf6-56c5-45f9-9940-5f218a8066ec" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "cinder-quobyte-9cf4fcc0-b053-4cca-8f53-2a0bc88a1742" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-9cf4fcc0-b053-4cca-8f53-2a0bc88a1742" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Deleting offline snapshot 9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 of volume 6f737bf6-56c5-45f9-9940-5f218a8066ec {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] snapshot_file for this snap is: volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22da7e5-db44-4e1d-ba0c-78b959dddba7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:18 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 Sep 05 04:58:18 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:18 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b" returned: 0 in 0.506s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:18 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b Sep 05 04:58:18 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:18 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742" returned: 0 in 0.481s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f737bf6-56c5-45f9-9940-5f218a8066ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84efa42-100d-492f-96b8-7ae160b3155d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:18 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b087297a-f8c5-424a-94cd-74c97e06277b" returned: 0 in 0.334s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-b087297a-f8c5-424a-94cd-74c97e06277b" released by "delete_volume" :: held 0.902s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created reservations ['157db466-7f50-477c-b2a2-cad66c08d238', '051bf2f4-71ee-423c-8c36-b116341cf95b', 'ca2f770a-b377-43e7-8861-684c3c763bfe', '7137c1a5-a9f2-45ed-868b-007c62bcadc5'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:18 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec Sep 05 04:58:18 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:19 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:19 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:19 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.306s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:19 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:19 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Deleted volume successfully. Sep 05 04:58:19 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a92639ca-c606-463e-aebf-0c971af36796 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-b087297a-f8c5-424a-94cd-74c97e06277b-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:19 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec" returned: 0 in 0.710s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:19 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 Sep 05 04:58:19 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:19 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742" returned: 0 in 0.424s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:19 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742 Sep 05 04:58:19 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-800423b6-351e-41fd-8cec-0639b7e26095-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-800423b6-351e-41fd-8cec-0639b7e26095-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "cinder-quobyte-800423b6-351e-41fd-8cec-0639b7e26095" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-800423b6-351e-41fd-8cec-0639b7e26095" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8576d8-f43f-40ec-8d0b-dce86205e336]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:20 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec.9cf4fcc0-b053-4cca-8f53-2a0bc88a1742" returned: 0 in 0.343s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-9cf4fcc0-b053-4cca-8f53-2a0bc88a1742" released by "_delete_snapshot" :: held 2.131s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-6f737bf6-56c5-45f9-9940-5f218a8066ec" released by "delete_snapshot" :: held 2.166s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:20 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095 Sep 05 04:58:20 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Created reservations ['e34d5958-483a-4db2-bb97-3285ca0d291a', 'b9724074-aa3a-4ff0-ab09-8def0784ca71', 'a0ed30a9-b265-4190-a846-6710f59287d3', 'aa063824-4984-4e91-a056-e520e30bf4be'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:20 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Delete snapshot completed successfully. Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-658faab1-73a7-408f-8276-ea5dadd62d57 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-9cf4fcc0-b053-4cca-8f53-2a0bc88a1742-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:20 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095" returned: 0 in 0.450s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:20 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095 Sep 05 04:58:20 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:20 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-800423b6-351e-41fd-8cec-0639b7e26095" returned: 0 in 0.271s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:20 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-quobyte-800423b6-351e-41fd-8cec-0639b7e26095" released by "delete_volume" :: held 0.779s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Created reservations ['28e3ad73-8c7b-4fbf-af4d-229a28f43208', '66596ea9-032b-4bca-a8ea-dd04ca4a645d', 'de48ff1a-23cc-415f-a32b-d0993b49bde2', '0b5c3983-adaf-4cf6-bea6-ae684aeac4bc'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:21 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:21 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "cinder-6f737bf6-56c5-45f9-9940-5f218a8066ec-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:21 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.274s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-6f737bf6-56c5-45f9-9940-5f218a8066ec-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:21 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Deleted volume successfully. Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-e19d17b9-038b-40c9-a75a-0c306e6433b4 tempest-CreateVolumesFromSourceVolumeTest-1540035422 None] Lock "cinder-800423b6-351e-41fd-8cec-0639b7e26095-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "cinder-quobyte-6f737bf6-56c5-45f9-9940-5f218a8066ec" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-6f737bf6-56c5-45f9-9940-5f218a8066ec" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d54ce8a-737f-4c80-9313-2ae19bfce716]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:21 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec Sep 05 04:58:21 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:21 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec" returned: 0 in 0.395s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:21 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec Sep 05 04:58:21 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:22 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-6f737bf6-56c5-45f9-9940-5f218a8066ec" returned: 0 in 0.283s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-6f737bf6-56c5-45f9-9940-5f218a8066ec" released by "delete_volume" :: held 0.754s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Created reservations ['a89cd9c9-617a-4eb0-9978-d1e2be73252d', 'afd87a31-e856-46d4-af07-c4507e3ce69f', 'cbc7d035-8541-4a84-bc94-0f7b25203d13', '7d99fb3b-9dc7-4c69-9121-4e05e6c4d270'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:22 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:22 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "cinder-40d0d562-3fff-488a-a102-d5c0471898de-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-40d0d562-3fff-488a-a102-d5c0471898de-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "cinder-quobyte-40d0d562-3fff-488a-a102-d5c0471898de" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:22 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.326s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-40d0d562-3fff-488a-a102-d5c0471898de" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:22 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Deleted volume successfully. Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4ee84d-d624-4f6b-8d85-c5f702d33e9c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:22 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-885fb579-baf1-4020-85c7-c864533a74fd tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-6f737bf6-56c5-45f9-9940-5f218a8066ec-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:23 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de Sep 05 04:58:23 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Flow 'volume_create_manager' (00a40d2a-0e45-47aa-bfdf-a3a2be8d5b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3067ff6d-0785-44e4-ac8e-a5efc8c76944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3067ff6d-0785-44e4-ac8e-a5efc8c76944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1444036259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc69a1e1-4406-4a5b-87af-85224844b303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b2bc43e4c4b1a943e5eec4bd4e706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:23Z,use_quota=True,user_id='9a3437ee594e433dbf590a4becdbc2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290eddb2-aa3c-4607-a9b1-10a1bb50a1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290eddb2-aa3c-4607-a9b1-10a1bb50a1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4a0d6b-85f2-485a-9556-aa0631c1afa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4a0d6b-85f2-485a-9556-aa0631c1afa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc69a1e1-4406-4a5b-87af-85224844b303', 'volume_name': 'volume-dc69a1e1-4406-4a5b-87af-85224844b303', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755d6a83-b404-4288-a707-e8b35c6bac81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755d6a83-b404-4288-a707-e8b35c6bac81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d4959a-09aa-4baa-9320-f6769065290c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:23 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Volume dc69a1e1-4406-4a5b-87af-85224844b303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc69a1e1-4406-4a5b-87af-85224844b303', 'volume_size': 1} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1444036259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc69a1e1-4406-4a5b-87af-85224844b303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b2bc43e4c4b1a943e5eec4bd4e706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:23Z,use_quota=True,user_id='9a3437ee594e433dbf590a4becdbc2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Creating volume dc69a1e1-4406-4a5b-87af-85224844b303 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:23 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:23 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303 1073741824 Sep 05 04:58:23 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:23 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de" returned: 0 in 0.695s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:23 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de Sep 05 04:58:23 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Flow 'volume_create_manager' (2316119a-1216-4371-9121-ae57ee37edc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c34d6ed-d2eb-40bf-bf26-73a3026b4cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c34d6ed-d2eb-40bf-bf26-73a3026b4cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1581871812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34ad5ed-583c-461b-a9ab-30532718136f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b2bc43e4c4b1a943e5eec4bd4e706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:24Z,use_quota=True,user_id='9a3437ee594e433dbf590a4becdbc2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a19743-1821-48ad-9935-77c1925c6a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a19743-1821-48ad-9935-77c1925c6a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f093b1-51cd-42a9-a287-7a6dce4cc384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f093b1-51cd-42a9-a287-7a6dce4cc384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34ad5ed-583c-461b-a9ab-30532718136f', 'volume_name': 'volume-b34ad5ed-583c-461b-a9ab-30532718136f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170fdff2-6e26-4110-88fc-737d5f7015fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170fdff2-6e26-4110-88fc-737d5f7015fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0799db-100f-4c05-b557-6c5727f1271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:23 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Volume b34ad5ed-583c-461b-a9ab-30532718136f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34ad5ed-583c-461b-a9ab-30532718136f', 'volume_size': 1} Sep 05 04:58:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:24 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-40d0d562-3fff-488a-a102-d5c0471898de" returned: 0 in 0.458s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-quobyte-40d0d562-3fff-488a-a102-d5c0471898de" released by "delete_volume" :: held 1.244s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Created reservations ['9c4864b7-16d9-4ddc-b636-9b54bf14b292', 'a0b0ef1f-cc95-4356-b61b-845ea32b9423', 'e2a8f99f-305e-44fa-8bcf-4dbc650795b6', '8540cb56-0251-4660-b971-84b2c2fcd1e9'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:24 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303 1073741824" returned: 0 in 0.868s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:24 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:24 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:24 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303 Sep 05 04:58:24 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:24 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303" returned: 0 in 0.309s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.641s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1581871812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34ad5ed-583c-461b-a9ab-30532718136f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b2bc43e4c4b1a943e5eec4bd4e706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:24Z,use_quota=True,user_id='9a3437ee594e433dbf590a4becdbc2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Creating volume b34ad5ed-583c-461b-a9ab-30532718136f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:24 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:24 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f 1073741824 Sep 05 04:58:24 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d4959a-09aa-4baa-9320-f6769065290c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc69a1e1-4406-4a5b-87af-85224844b303', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d84219c-29bc-476d-a095-d17c53104c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:24 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Volume volume-dc69a1e1-4406-4a5b-87af-85224844b303 (dc69a1e1-4406-4a5b-87af-85224844b303): created successfully Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d84219c-29bc-476d-a095-d17c53104c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Flow 'volume_create_manager' (00a40d2a-0e45-47aa-bfdf-a3a2be8d5b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:24 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8862318b-8957-419b-8929-2555b958a696 tempest-CreateVolumesFromImageTest-1457045222 None] Created volume successfully. Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Flow 'volume_create_manager' (5518671e-d105-45eb-9ee1-b2ce4650bb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:24 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023a5d20-980a-434c-9194-482f86f53a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.642s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023a5d20-980a-434c-9194-482f86f53a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-903493820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e541f2e-67ca-4f7f-a131-a7929debfcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b2bc43e4c4b1a943e5eec4bd4e706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:25Z,use_quota=True,user_id='9a3437ee594e433dbf590a4becdbc2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752fcf62-02a0-49f3-a348-b0259f155737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752fcf62-02a0-49f3-a348-b0259f155737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500efb0f-bbe9-4b7b-876d-2be843777c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:24 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500efb0f-bbe9-4b7b-876d-2be843777c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e541f2e-67ca-4f7f-a131-a7929debfcfd', 'volume_name': 'volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b46289-291a-4a9b-9010-7055c497a374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b46289-291a-4a9b-9010-7055c497a374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17c018d-bd46-473c-98ad-76efdaee153f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:25 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Volume 4e541f2e-67ca-4f7f-a131-a7929debfcfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd', 'volume_size': 1} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:25 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Deleted volume successfully. Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c724cd4a-3f43-44ed-95e2-2d2419233ff4 tempest-VolumeDependencyTests-1374403442 None] Lock "cinder-40d0d562-3fff-488a-a102-d5c0471898de-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Flow 'volume_create_manager' (cf409cbd-4978-4b06-88d5-6733cc2326a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73da7236-53d3-442b-a589-c3283f05fbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73da7236-53d3-442b-a589-c3283f05fbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1005467296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d6ac13-cbf9-49f1-8a37-647b8aa3c969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b2bc43e4c4b1a943e5eec4bd4e706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:25Z,use_quota=True,user_id='9a3437ee594e433dbf590a4becdbc2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb135728-5a27-4261-a7ac-1cc71d026289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb135728-5a27-4261-a7ac-1cc71d026289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd079af-3088-40f3-9e6d-f146dbb5a9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd079af-3088-40f3-9e6d-f146dbb5a9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d6ac13-cbf9-49f1-8a37-647b8aa3c969', 'volume_name': 'volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c033f17a-4e68-430c-84ea-9f636d814d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c033f17a-4e68-430c-84ea-9f636d814d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c28bfc-0040-423b-ab92-ea21b0744af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:25 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Volume 49d6ac13-cbf9-49f1-8a37-647b8aa3c969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969', 'volume_size': 1} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f 1073741824" returned: 0 in 0.917s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:25 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:25 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f Sep 05 04:58:25 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:25 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Flow 'volume_create_manager' (01e225f4-c21b-4891-968d-712b163f9ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13a4b3b-0c2d-4960-aabd-b3ef29bdf7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13a4b3b-0c2d-4960-aabd-b3ef29bdf7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1520665698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dbf501-8289-4dbc-be0f-899d20a7e730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b2bc43e4c4b1a943e5eec4bd4e706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:26Z,use_quota=True,user_id='9a3437ee594e433dbf590a4becdbc2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c7a9bc-f86e-46dc-9ef5-8bb6355653ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:26 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c7a9bc-f86e-46dc-9ef5-8bb6355653ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae224ed7-dd1d-4c39-81a6-e038c8fd30a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae224ed7-dd1d-4c39-81a6-e038c8fd30a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73dbf501-8289-4dbc-be0f-899d20a7e730', 'volume_name': 'volume-73dbf501-8289-4dbc-be0f-899d20a7e730', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086ac5e0-a77d-40b2-8acf-426df5d3a781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086ac5e0-a77d-40b2-8acf-426df5d3a781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd89e0f-7610-4f38-b125-a10691b11687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:26 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Volume 73dbf501-8289-4dbc-be0f-899d20a7e730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73dbf501-8289-4dbc-be0f-899d20a7e730', 'volume_size': 1} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f" returned: 0 in 0.549s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.128s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-903493820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e541f2e-67ca-4f7f-a131-a7929debfcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b2bc43e4c4b1a943e5eec4bd4e706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:25Z,use_quota=True,user_id='9a3437ee594e433dbf590a4becdbc2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Creating volume 4e541f2e-67ca-4f7f-a131-a7929debfcfd {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:26 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:26 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd 1073741824 Sep 05 04:58:26 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0799db-100f-4c05-b557-6c5727f1271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34ad5ed-583c-461b-a9ab-30532718136f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664c7e93-b7ea-4d3f-8652-c962fbb48d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:26 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Volume volume-b34ad5ed-583c-461b-a9ab-30532718136f (b34ad5ed-583c-461b-a9ab-30532718136f): created successfully Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664c7e93-b7ea-4d3f-8652-c962fbb48d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Flow 'volume_create_manager' (2316119a-1216-4371-9121-ae57ee37edc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:26 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-08ba10ea-cf52-4c56-b61a-6ea23402a0b1 tempest-CreateVolumesFromImageTest-1457045222 None] Created volume successfully. Sep 05 04:58:26 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd 1073741824" returned: 0 in 0.591s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:26 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd Sep 05 04:58:26 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b2bd4516-e429-4cc6-9590-446f2f022502 tempest-ProjectAdminTests-531548045 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7087516784668, 'free_capacity_gb': 1773.7087516784668, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89807) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 04:58:27 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd" returned: 0 in 0.368s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1005467296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d6ac13-cbf9-49f1-8a37-647b8aa3c969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b2bc43e4c4b1a943e5eec4bd4e706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:25Z,use_quota=True,user_id='9a3437ee594e433dbf590a4becdbc2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Creating volume 49d6ac13-cbf9-49f1-8a37-647b8aa3c969 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:27 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17c018d-bd46-473c-98ad-76efdaee153f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff89a53e-3e40-4b7e-9623-74dd5e52abf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:27 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969 1073741824 Sep 05 04:58:27 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:27 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Volume volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd (4e541f2e-67ca-4f7f-a131-a7929debfcfd): created successfully Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff89a53e-3e40-4b7e-9623-74dd5e52abf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Flow 'volume_create_manager' (5518671e-d105-45eb-9ee1-b2ce4650bb6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:27 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d18e0310-94fd-445c-b6ce-56f185ed536b tempest-CreateVolumesFromImageTest-1457045222 None] Created volume successfully. Sep 05 04:58:27 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969 1073741824" returned: 0 in 0.587s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:27 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969 Sep 05 04:58:27 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:28 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969" returned: 0 in 0.289s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.017s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1520665698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dbf501-8289-4dbc-be0f-899d20a7e730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b2bc43e4c4b1a943e5eec4bd4e706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:26Z,use_quota=True,user_id='9a3437ee594e433dbf590a4becdbc2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Creating volume 73dbf501-8289-4dbc-be0f-899d20a7e730 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:28 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c28bfc-0040-423b-ab92-ea21b0744af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:28 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730 1073741824 Sep 05 04:58:28 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f677e6-edbc-497b-818b-a29564369c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:28 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Volume volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969 (49d6ac13-cbf9-49f1-8a37-647b8aa3c969): created successfully Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f677e6-edbc-497b-818b-a29564369c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Flow 'volume_create_manager' (cf409cbd-4978-4b06-88d5-6733cc2326a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:28 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f41dd1e4-a2a5-4e24-862b-6d3faa8c44b1 tempest-CreateVolumesFromImageTest-1457045222 None] Created volume successfully. Sep 05 04:58:28 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730 1073741824" returned: 0 in 0.593s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:28 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730 Sep 05 04:58:28 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:29 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730" returned: 0 in 0.348s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd89e0f-7610-4f38-b125-a10691b11687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73dbf501-8289-4dbc-be0f-899d20a7e730', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7529df3c-b9b3-4843-b144-73f6f07c2383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:29 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Volume volume-73dbf501-8289-4dbc-be0f-899d20a7e730 (73dbf501-8289-4dbc-be0f-899d20a7e730): created successfully Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7529df3c-b9b3-4843-b144-73f6f07c2383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Flow 'volume_create_manager' (01e225f4-c21b-4891-968d-712b163f9ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:29 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-845d1f6c-2612-496d-a860-c70d10a91269 tempest-CreateVolumesFromImageTest-1457045222 None] Created volume successfully. Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "cinder-73dbf501-8289-4dbc-be0f-899d20a7e730-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-73dbf501-8289-4dbc-be0f-899d20a7e730-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "cinder-quobyte-73dbf501-8289-4dbc-be0f-899d20a7e730" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-quobyte-73dbf501-8289-4dbc-be0f-899d20a7e730" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[feebf90a-3bf1-4e61-bec8-e5d9b52d83bc]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:29 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730 Sep 05 04:58:29 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:30 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730" returned: 0 in 0.467s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:30 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730 Sep 05 04:58:30 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Flow 'volume_create_manager' (799af0ca-7f6b-4fed-b206-ca9d40c478c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53caed0-cc31-4445-b226-fac0371500c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53caed0-cc31-4445-b226-fac0371500c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7090860-91a2-40f6-ad44-2daefe12b2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1d53c254ee41a48160c8ab3ad01663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:30Z,use_quota=True,user_id='0280428a8a9646ae8486c17f80368d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e5bed1-f730-460f-99b6-cb90f0b58c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e5bed1-f730-460f-99b6-cb90f0b58c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7696809d-ff50-49f2-9a2f-e54fa575df5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7696809d-ff50-49f2-9a2f-e54fa575df5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7090860-91a2-40f6-ad44-2daefe12b2b5', 'volume_name': 'volume-c7090860-91a2-40f6-ad44-2daefe12b2b5', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81dc397-8554-4627-acef-81771c9a0bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81dc397-8554-4627-acef-81771c9a0bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b408a0b-f39c-4d68-a370-1e3ba0cd24ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Volume c7090860-91a2-40f6-ad44-2daefe12b2b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7090860-91a2-40f6-ad44-2daefe12b2b5', 'volume_size': 1} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7090860-91a2-40f6-ad44-2daefe12b2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1d53c254ee41a48160c8ab3ad01663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:30Z,use_quota=True,user_id='0280428a8a9646ae8486c17f80368d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Creating volume c7090860-91a2-40f6-ad44-2daefe12b2b5 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:30 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:30 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:30 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5 1073741824 Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-73dbf501-8289-4dbc-be0f-899d20a7e730" returned: 0 in 0.317s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:30 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-quobyte-73dbf501-8289-4dbc-be0f-899d20a7e730" released by "delete_volume" :: held 0.850s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Created reservations ['bcef1fa4-78d5-4e9e-90ea-f882896fb66b', 'bb24dd51-d210-44c6-8b40-95346ecdde7e', '2e654d58-9d0a-455e-8b80-ed9213460d10', '73d76ca2-b223-40c3-86ec-84cb088cc11f'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "cinder-49d6ac13-cbf9-49f1-8a37-647b8aa3c969-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:30 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:30 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-49d6ac13-cbf9-49f1-8a37-647b8aa3c969-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "cinder-quobyte-49d6ac13-cbf9-49f1-8a37-647b8aa3c969" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-quobyte-49d6ac13-cbf9-49f1-8a37-647b8aa3c969" acquired by "delete_volume" :: waited 0.028s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[15201b7c-2fec-4774-a75d-38f2c0519de5]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:31 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5 1073741824" returned: 0 in 0.674s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:31 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:31 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969 Sep 05 04:58:31 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.406s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:31 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Deleted volume successfully. Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-93073a17-4685-4e12-a2c7-89057d046dcf tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-73dbf501-8289-4dbc-be0f-899d20a7e730-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:31 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5 Sep 05 04:58:31 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:31 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969" returned: 0 in 0.508s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:31 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5" returned: 0 in 0.311s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:31 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969 Sep 05 04:58:31 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b408a0b-f39c-4d68-a370-1e3ba0cd24ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7090860-91a2-40f6-ad44-2daefe12b2b5', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7530e2b-c62e-4efe-8445-7f9638d4b052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:31 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Volume volume-c7090860-91a2-40f6-ad44-2daefe12b2b5 (c7090860-91a2-40f6-ad44-2daefe12b2b5): created successfully Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7530e2b-c62e-4efe-8445-7f9638d4b052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Flow 'volume_create_manager' (799af0ca-7f6b-4fed-b206-ca9d40c478c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:31 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-fcaf2da1-f442-41b1-82c3-b53c4ad406f1 tempest-CinderUnicodeTest-710279916 None] Created volume successfully. Sep 05 04:58:31 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-49d6ac13-cbf9-49f1-8a37-647b8aa3c969" returned: 0 in 0.318s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-quobyte-49d6ac13-cbf9-49f1-8a37-647b8aa3c969" released by "delete_volume" :: held 0.903s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Created reservations ['ee819cab-2ad9-4010-bbbb-94617cb241de', '3e6aca9d-7170-41a7-ae6e-1b5bd57e70ed', 'c07bcc72-697a-433c-87c1-daed472d2277', 'd1d4e072-0fdf-41f6-b0de-abce0c63412c'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:31 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:31 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "cinder-4e541f2e-67ca-4f7f-a131-a7929debfcfd-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-4e541f2e-67ca-4f7f-a131-a7929debfcfd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "cinder-quobyte-4e541f2e-67ca-4f7f-a131-a7929debfcfd" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-quobyte-4e541f2e-67ca-4f7f-a131-a7929debfcfd" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcbde62-6329-4549-b5bc-49bad765a2f7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:32 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.328s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Deleted volume successfully. Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f46de7f3-904c-4877-8191-b4e15e7aa108 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-49d6ac13-cbf9-49f1-8a37-647b8aa3c969-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:32 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd Sep 05 04:58:32 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:32 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd" returned: 0 in 0.538s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:32 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd Sep 05 04:58:32 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:32 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-4e541f2e-67ca-4f7f-a131-a7929debfcfd" returned: 0 in 0.318s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-quobyte-4e541f2e-67ca-4f7f-a131-a7929debfcfd" released by "delete_volume" :: held 0.917s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Created reservations ['b760fcae-96fb-41c5-b8a7-5485c2602ad7', '25d44e8d-a32e-47c0-9a63-1d802087c40c', '0bb3b180-ad35-4575-bcbc-5f3eceb19cc2', '63117f5a-f646-4d0e-b9f0-cb4eb5582744'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:33 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:33 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Flow 'volume_create_manager' (eba9984f-452e-4c39-ad97-2f4cfe84aaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac42e7a4-baa5-4634-ad7d-948cf06883d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac42e7a4-baa5-4634-ad7d-948cf06883d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-277008167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df707b5c-332a-447e-9281-128686977dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1d53c254ee41a48160c8ab3ad01663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:33Z,use_quota=True,user_id='0280428a8a9646ae8486c17f80368d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f67133-e138-48df-8e69-805dd0dac8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f67133-e138-48df-8e69-805dd0dac8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21b3848-514d-43f3-9989-bf41d44c3724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21b3848-514d-43f3-9989-bf41d44c3724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df707b5c-332a-447e-9281-128686977dd0', 'volume_name': 'volume-df707b5c-332a-447e-9281-128686977dd0', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5085f5ac-95be-4292-b4f1-f2214fc15766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5085f5ac-95be-4292-b4f1-f2214fc15766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a721347-b276-4da1-95c6-abdf16302f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:33 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Volume df707b5c-332a-447e-9281-128686977dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df707b5c-332a-447e-9281-128686977dd0', 'volume_size': 1} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-277008167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df707b5c-332a-447e-9281-128686977dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1d53c254ee41a48160c8ab3ad01663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:33Z,use_quota=True,user_id='0280428a8a9646ae8486c17f80368d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Creating volume df707b5c-332a-447e-9281-128686977dd0 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:33 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:33 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 1073741824 Sep 05 04:58:33 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Flow 'volume_create_manager' (5b29681d-112a-4b03-9386-8b0c161d400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:33 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a466feb0-82ed-4a18-950a-c44e61662708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.319s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:33 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Deleted volume successfully. Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a466feb0-82ed-4a18-950a-c44e61662708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337724881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fb0cbf-9e27-4387-82b1-642385530279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4873896f73a84ffc9f852ad1e2000a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:33Z,use_quota=True,user_id='3243fb5bb12d4bb7828ce16f18d4331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d56ec87-a614-4b29-a25c-5d4937b61e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d56ec87-a614-4b29-a25c-5d4937b61e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c96bde-b5fd-4c34-9a86-261a5ec0c7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c96bde-b5fd-4c34-9a86-261a5ec0c7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fb0cbf-9e27-4387-82b1-642385530279', 'volume_name': 'volume-26fb0cbf-9e27-4387-82b1-642385530279', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fd162a-d887-48d0-80ba-5bc056cc6f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fd162a-d887-48d0-80ba-5bc056cc6f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3778cdd-1e48-4c7f-bb13-cabe61fabfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:33 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Volume 26fb0cbf-9e27-4387-82b1-642385530279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fb0cbf-9e27-4387-82b1-642385530279', 'volume_size': 1} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-cea392ef-f198-4936-a5b0-36a2cd6c7b14 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-4e541f2e-67ca-4f7f-a131-a7929debfcfd-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:33 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 1073741824" returned: 0 in 0.496s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:33 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 Sep 05 04:58:33 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:34 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0" returned: 0 in 0.261s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337724881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fb0cbf-9e27-4387-82b1-642385530279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4873896f73a84ffc9f852ad1e2000a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:33Z,use_quota=True,user_id='3243fb5bb12d4bb7828ce16f18d4331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Creating volume 26fb0cbf-9e27-4387-82b1-642385530279 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:34 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a721347-b276-4da1-95c6-abdf16302f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df707b5c-332a-447e-9281-128686977dd0', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e429f4ab-0db1-4e46-94a6-354c5321ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:34 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 1073741824 Sep 05 04:58:34 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "cinder-b34ad5ed-583c-461b-a9ab-30532718136f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:34 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Volume volume-df707b5c-332a-447e-9281-128686977dd0 (df707b5c-332a-447e-9281-128686977dd0): created successfully Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e429f4ab-0db1-4e46-94a6-354c5321ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Flow 'volume_create_manager' (eba9984f-452e-4c39-ad97-2f4cfe84aaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-b34ad5ed-583c-461b-a9ab-30532718136f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:34 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c5fab50e-e7b2-4d9e-9173-3c6d45145a25 tempest-CinderUnicodeTest-710279916 None] Created volume successfully. Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "cinder-quobyte-b34ad5ed-583c-461b-a9ab-30532718136f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-quobyte-b34ad5ed-583c-461b-a9ab-30532718136f" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[63be7c54-a0d6-4798-9ed9-c6446400a565]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:34 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f Sep 05 04:58:34 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:34 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 1073741824" returned: 0 in 0.521s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:34 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 Sep 05 04:58:34 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:34 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f" returned: 0 in 0.439s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:34 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f Sep 05 04:58:34 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:35 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279" returned: 0 in 0.290s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3778cdd-1e48-4c7f-bb13-cabe61fabfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fb0cbf-9e27-4387-82b1-642385530279', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a213084-a0c4-43de-8284-763583fd52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:35 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Volume volume-26fb0cbf-9e27-4387-82b1-642385530279 (26fb0cbf-9e27-4387-82b1-642385530279): created successfully Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a213084-a0c4-43de-8284-763583fd52bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Flow 'volume_create_manager' (5b29681d-112a-4b03-9386-8b0c161d400d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:35 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b34ad5ed-583c-461b-a9ab-30532718136f" returned: 0 in 0.295s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a8316ce6-41ec-4b02-b7da-2b2027eb2c09 tempest-ProjectReaderTests-390922480 None] Created volume successfully. Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-quobyte-b34ad5ed-583c-461b-a9ab-30532718136f" released by "delete_volume" :: held 0.797s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Created reservations ['f4fb9a11-70b7-47d5-aaed-faccb4152ec9', '2d066e0f-b59b-4ee8-8541-21b3d19c852e', '4e9d4cfe-f658-4f5c-acc4-ce8f8cf73cd5', '8943b30b-fb90-4df4-be3c-5d7b3092786a'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:35 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:35 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "cinder-dc69a1e1-4406-4a5b-87af-85224844b303-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-dc69a1e1-4406-4a5b-87af-85224844b303-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Creating offline snapshot 22a32a67-04c5-49d8-b618-60e69009c406 of volume 26fb0cbf-9e27-4387-82b1-642385530279 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:35 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.377s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[530fdf8b-b46f-4dd6-8a7d-f00191f80e1e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:35 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Deleted volume successfully. Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "cinder-quobyte-dc69a1e1-4406-4a5b-87af-85224844b303" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bfde678a-6a09-4227-8946-b082769e4a2a tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-b34ad5ed-583c-461b-a9ab-30532718136f-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-quobyte-dc69a1e1-4406-4a5b-87af-85224844b303" acquired by "delete_volume" :: waited 0.028s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4ad8a1-50ad-4417-be74-d3ec5635f4f4]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:35 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 Sep 05 04:58:35 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:35 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303 Sep 05 04:58:35 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:36 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279" returned: 0 in 0.457s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:36 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 1G Sep 05 04:58:36 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:36 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303" returned: 0 in 0.421s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:36 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303 Sep 05 04:58:36 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (8431cc70-e29f-4db5-9bcd-34acd038de89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb2f394-4cc7-4517-bffc-6890cc84f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb2f394-4cc7-4517-bffc-6890cc84f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754343457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8043b8-dc20-411b-b79c-3b0632bd8ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:36Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9262ab9-d60e-4108-a57c-b03896a58236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9262ab9-d60e-4108-a57c-b03896a58236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255848c9-0c9c-4d65-8226-a42d295659af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255848c9-0c9c-4d65-8226-a42d295659af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8043b8-dc20-411b-b79c-3b0632bd8ba4', 'volume_name': 'volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ab0c8e-260e-4d01-aca1-2f0d84a71e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ab0c8e-260e-4d01-aca1-2f0d84a71e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d0cce8-a096-4e73-9328-f1751bff97eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:36 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Volume 0f8043b8-dc20-411b-b79c-3b0632bd8ba4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4', 'volume_size': 1} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:36 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dc69a1e1-4406-4a5b-87af-85224844b303" returned: 0 in 0.255s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-quobyte-dc69a1e1-4406-4a5b-87af-85224844b303" released by "delete_volume" :: held 0.722s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Created reservations ['68949bdd-47ce-4d12-8fe9-438927a131a2', 'fac0ca7d-b336-4364-a8d5-7ca23e3a2aca', 'b0eb6eb9-af6d-415c-8500-99c1ee9bb3d3', 'cba0b3e9-fc21-4d26-a79d-2a11646e848a'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:36 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 1G" returned: 0 in 0.459s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fb0cbf-9e27-4387-82b1-642385530279 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:36 devstack sudo[109122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fb0cbf-9e27-4387-82b1-642385530279 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 Sep 05 04:58:36 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:36 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:36 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:36 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:36 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fb0cbf-9e27-4387-82b1-642385530279 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406" returned: 0 in 0.320s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:36 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 is being set with open permissions: ugo+rw Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.299s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:36 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:36 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Deleted volume successfully. Sep 05 04:58:36 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 Sep 05 04:58:36 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ddffaae-b839-4262-a0bd-bec258c75979 tempest-CreateVolumesFromImageTest-1457045222 None] Lock "cinder-dc69a1e1-4406-4a5b-87af-85224844b303-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:37 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406" returned: 0 in 0.269s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:37 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.info Sep 05 04:58:37 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:37 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.info" returned: 0 in 0.278s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:37 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.info is being set with open permissions: ugo+rw Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:37 devstack sudo[109136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.info Sep 05 04:58:37 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:37 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.info" returned: 0 in 0.283s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.141s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Creating offline snapshot ebd706cd-d01b-4877-9250-29f20bbc3899 of volume df707b5c-332a-447e-9281-128686977dd0 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[af806d3b-f1c3-43b2-bece-e73ca4359e16]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:37 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:37 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-92f6a922-f679-405d-acf2-f287f67e1e34 tempest-ProjectReaderTests-390922480 None] Create snapshot completed successfully Sep 05 04:58:38 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 Sep 05 04:58:38 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:38 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0" returned: 0 in 0.395s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:38 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 1G Sep 05 04:58:38 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:38 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 1G" returned: 0 in 0.487s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df707b5c-332a-447e-9281-128686977dd0 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:38 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df707b5c-332a-447e-9281-128686977dd0 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 Sep 05 04:58:38 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-22a32a67-04c5-49d8-b618-60e69009c406-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Lock "cinder-22a32a67-04c5-49d8-b618-60e69009c406-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-26fb0cbf-9e27-4387-82b1-642385530279" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-26fb0cbf-9e27-4387-82b1-642385530279" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-22a32a67-04c5-49d8-b618-60e69009c406" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:39 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df707b5c-332a-447e-9281-128686977dd0 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899" returned: 0 in 0.374s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:39 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 is being set with open permissions: ugo+rw Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-22a32a67-04c5-49d8-b618-60e69009c406" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Deleting offline snapshot 22a32a67-04c5-49d8-b618-60e69009c406 of volume 26fb0cbf-9e27-4387-82b1-642385530279 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:58:39 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 Sep 05 04:58:39 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] snapshot_file for this snap is: volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cb9274-cbde-4f32-a12e-44799a982a33]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:39 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 Sep 05 04:58:39 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:39 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899" returned: 0 in 0.284s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:39 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.info Sep 05 04:58:39 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:39 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406" returned: 0 in 0.419s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26fb0cbf-9e27-4387-82b1-642385530279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f479333-f04c-442d-879c-e21f63596181]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:39 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.info" returned: 0 in 0.282s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:39 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.info is being set with open permissions: ugo+rw Sep 05 04:58:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:39 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.info Sep 05 04:58:39 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:39 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 Sep 05 04:58:39 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:40 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.info" returned: 0 in 0.288s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:40 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.690s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754343457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8043b8-dc20-411b-b79c-3b0632bd8ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:36Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Creating volume 0f8043b8-dc20-411b-b79c-3b0632bd8ba4 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:40 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279" returned: 0 in 0.428s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:40 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 1073741824 Sep 05 04:58:40 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:40 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 Sep 05 04:58:40 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:40 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7fd5c438-cee6-4a3f-a13a-b125d327181e tempest-CinderUnicodeTest-710279916 None] Create snapshot completed successfully Sep 05 04:58:40 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (a8f1c20a-414d-438a-b658-1c203c63ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3519f876-fdbf-45ea-b17c-ce8e3951fe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406" returned: 0 in 0.484s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:40 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3519f876-fdbf-45ea-b17c-ce8e3951fe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-907854377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420e8906-5991-416a-b57a-6bb831548e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:40Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:40 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406 Sep 05 04:58:40 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05cfd29-de07-4a73-8728-669beb9c2295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05cfd29-de07-4a73-8728-669beb9c2295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4164a474-47a5-485d-b288-a0754e3dfacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4164a474-47a5-485d-b288-a0754e3dfacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420e8906-5991-416a-b57a-6bb831548e22', 'volume_name': 'volume-420e8906-5991-416a-b57a-6bb831548e22', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17973da-071b-4af8-8a84-d0f567cb1dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17973da-071b-4af8-8a84-d0f567cb1dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2404107d-9319-4386-a35b-9ed84c4e45a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:40 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume 420e8906-5991-416a-b57a-6bb831548e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420e8906-5991-416a-b57a-6bb831548e22', 'volume_size': 1} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 1073741824" returned: 0 in 0.568s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:40 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 Sep 05 04:58:40 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:40 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Acquiring lock "cinder-ebd706cd-d01b-4877-9250-29f20bbc3899-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279.22a32a67-04c5-49d8-b618-60e69009c406" returned: 0 in 0.318s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-22a32a67-04c5-49d8-b618-60e69009c406" released by "_delete_snapshot" :: held 1.775s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Lock "cinder-ebd706cd-d01b-4877-9250-29f20bbc3899-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Acquiring lock "cinder-quobyte-df707b5c-332a-447e-9281-128686977dd0" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-26fb0cbf-9e27-4387-82b1-642385530279" released by "delete_snapshot" :: held 1.828s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Lock "cinder-quobyte-df707b5c-332a-447e-9281-128686977dd0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Acquiring lock "cinder-quobyte-ebd706cd-d01b-4877-9250-29f20bbc3899" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:40 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" returned: 0 in 0.298s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-907854377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420e8906-5991-416a-b57a-6bb831548e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:40Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Creating volume 420e8906-5991-416a-b57a-6bb831548e22 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:40 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Lock "cinder-quobyte-ebd706cd-d01b-4877-9250-29f20bbc3899" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Deleting offline snapshot ebd706cd-d01b-4877-9250-29f20bbc3899 of volume df707b5c-332a-447e-9281-128686977dd0 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:58:41 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 1073741824 Sep 05 04:58:41 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] snapshot_file for this snap is: volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d0cce8-a096-4e73-9328-f1751bff97eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86afafac-7a7a-48c5-8d47-8ee94b35de04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9cd526-8afc-41b1-bc2f-60e89cf2f30f]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:41 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Volume volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 (0f8043b8-dc20-411b-b79c-3b0632bd8ba4): created successfully Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86afafac-7a7a-48c5-8d47-8ee94b35de04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (8431cc70-e29f-4db5-9bcd-34acd038de89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:41 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7ab1eb49-395c-423a-b295-5cc57a3110ec tempest-ProjectMemberTests-181407164 None] Created volume successfully. Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Created reservations ['f145782d-456a-4eef-9797-ca9413ea8828', '7eca3f3c-42df-4fa6-a5ad-4a5976de6e15', '85be77fc-5238-4ad7-8e02-1e9234ad0557', '09c9983b-2cf4-413a-81db-f2606d0c7d91'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:41 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 Sep 05 04:58:41 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:41 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Delete snapshot completed successfully. Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-31e80d53-3652-48df-a504-d2d48da54430 tempest-ProjectReaderTests-390922480 None] Lock "cinder-22a32a67-04c5-49d8-b618-60e69009c406-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-26fb0cbf-9e27-4387-82b1-642385530279-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Lock "cinder-26fb0cbf-9e27-4387-82b1-642385530279-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-26fb0cbf-9e27-4387-82b1-642385530279" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-26fb0cbf-9e27-4387-82b1-642385530279" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6fbab9-b1a8-44d0-8b26-81d644363b8d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:41 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899" returned: 0 in 0.497s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df707b5c-332a-447e-9281-128686977dd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:58:41 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 1073741824" returned: 0 in 0.590s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef15d1c5-7c21-44ed-ae3c-541796ed12d9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:41 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 Sep 05 04:58:41 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:41 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 Sep 05 04:58:41 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:41 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 Sep 05 04:58:41 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:41 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:41 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279" returned: 0 in 0.549s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22" returned: 0 in 0.360s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:42 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279 Sep 05 04:58:42 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2404107d-9319-4386-a35b-9ed84c4e45a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420e8906-5991-416a-b57a-6bb831548e22', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0071197c-9fd7-4c46-a4c8-76ba82280b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume volume-420e8906-5991-416a-b57a-6bb831548e22 (420e8906-5991-416a-b57a-6bb831548e22): created successfully Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0071197c-9fd7-4c46-a4c8-76ba82280b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (a8f1c20a-414d-438a-b658-1c203c63ba47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Creating offline snapshot e57ee788-42f7-4004-ab29-fed5724d59f4 of volume 0f8043b8-dc20-411b-b79c-3b0632bd8ba4 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:58:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-30bef79d-a6a6-40ce-9ecf-e24778cf8213 tempest-CreateVolumesFromSnapshotTest-832519806 None] Created volume successfully. Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9186d29-39e6-4793-93dd-fdf41aab9394]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:42 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0" returned: 0 in 0.558s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:42 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 Sep 05 04:58:42 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:42 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 Sep 05 04:58:42 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:42 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-26fb0cbf-9e27-4387-82b1-642385530279" returned: 0 in 0.285s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-26fb0cbf-9e27-4387-82b1-642385530279" released by "delete_volume" :: held 0.907s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Created reservations ['959aa5df-423f-4b7e-973a-9b3c064f9824', 'abe98c88-9fef-4d38-bbdf-11525febf4ca', 'c7e800d1-db1e-4376-960b-43d989fc6f70', '41fddbec-f867-4364-9593-d7c9150edbde'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:42 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:42 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:42 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" returned: 0 in 0.471s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:42 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 1G Sep 05 04:58:42 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:42 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899" returned: 0 in 0.499s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:42 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899 Sep 05 04:58:42 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:42 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.351s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Deleted volume successfully. Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2ed95a5f-5df7-43fc-865a-e69024b3a65a tempest-ProjectReaderTests-390922480 None] Lock "cinder-26fb0cbf-9e27-4387-82b1-642385530279-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:42 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0.ebd706cd-d01b-4877-9250-29f20bbc3899" returned: 0 in 0.344s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Lock "cinder-quobyte-ebd706cd-d01b-4877-9250-29f20bbc3899" released by "_delete_snapshot" :: held 2.078s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Lock "cinder-quobyte-df707b5c-332a-447e-9281-128686977dd0" released by "delete_snapshot" :: held 2.151s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Created reservations ['eff2d9dc-bf2d-4c56-8db8-aa73ae7ea00a', 'a96c7a7f-54d8-4a67-9b9b-8b0039dea7ac', '3fee6fd4-f413-4956-92f0-21bf53cc5986', '5cd944d5-8ebc-41a7-893e-3d6f9ee962a0'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:43 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 1G" returned: 0 in 0.649s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:43 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 Sep 05 04:58:43 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Flow 'volume_create_manager' (43a2e34b-ab88-42b8-995c-a08cd842995d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d75deae-4398-4460-93c8-2eefb298fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d75deae-4398-4460-93c8-2eefb298fb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250229515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cd9332-4896-472d-aa5c-301153333f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4873896f73a84ffc9f852ad1e2000a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:43Z,use_quota=True,user_id='3243fb5bb12d4bb7828ce16f18d4331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0485a7-e704-46d4-b927-d88d072fc115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0485a7-e704-46d4-b927-d88d072fc115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84521f0e-6add-4bbd-9f32-7f29633d2df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84521f0e-6add-4bbd-9f32-7f29633d2df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19cd9332-4896-472d-aa5c-301153333f65', 'volume_name': 'volume-19cd9332-4896-472d-aa5c-301153333f65', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c462e3d-afc3-4fb5-87ab-c06a1789eaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c462e3d-afc3-4fb5-87ab-c06a1789eaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94406083-cfcb-49f1-994d-27bfd326a35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:43 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Volume 19cd9332-4896-472d-aa5c-301153333f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19cd9332-4896-472d-aa5c-301153333f65', 'volume_size': 1} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:43 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Delete snapshot completed successfully. Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bbdf7d39-4a18-4eb6-8c75-c7d56daf3775 tempest-CinderUnicodeTest-710279916 None] Lock "cinder-ebd706cd-d01b-4877-9250-29f20bbc3899-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:43 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4" returned: 0 in 0.301s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:43 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 is being set with open permissions: ugo+rw Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:43 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 Sep 05 04:58:43 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:43 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:43 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:43 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.info Sep 05 04:58:43 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:44 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.info" returned: 0 in 0.250s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:44 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.info is being set with open permissions: ugo+rw Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:44 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.info Sep 05 04:58:44 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Acquiring lock "cinder-df707b5c-332a-447e-9281-128686977dd0-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Lock "cinder-df707b5c-332a-447e-9281-128686977dd0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Acquiring lock "cinder-quobyte-df707b5c-332a-447e-9281-128686977dd0" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Lock "cinder-quobyte-df707b5c-332a-447e-9281-128686977dd0" acquired by "delete_volume" :: waited 0.027s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde6b68-2484-42fe-84e4-edec40e60b2e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:44 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.info" returned: 0 in 0.298s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.352s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.003s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250229515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cd9332-4896-472d-aa5c-301153333f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4873896f73a84ffc9f852ad1e2000a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:43Z,use_quota=True,user_id='3243fb5bb12d4bb7828ce16f18d4331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Creating volume 19cd9332-4896-472d-aa5c-301153333f65 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:44 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:44 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 1073741824 Sep 05 04:58:44 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:44 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a23fbe5e-1dc3-428e-9db8-9ab7faa9d156 tempest-ProjectMemberTests-181407164 None] Create snapshot completed successfully Sep 05 04:58:44 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 Sep 05 04:58:44 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:44 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0" returned: 0 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:44 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0 Sep 05 04:58:44 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:44 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 1073741824" returned: 0 in 0.461s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:44 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 Sep 05 04:58:44 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:45 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-df707b5c-332a-447e-9281-128686977dd0" returned: 0 in 0.281s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Lock "cinder-quobyte-df707b5c-332a-447e-9281-128686977dd0" released by "delete_volume" :: held 0.735s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Created reservations ['8fcc50ab-050c-4178-b6a9-a9c292e75b85', 'f5cb93b9-aa28-4c79-8125-cfae03c03c1f', '5950aca6-c0d9-4063-8830-a4c2bf4c6b69', '874b499c-ad7c-4633-bc3b-dcef196276fb'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:45 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65" returned: 0 in 0.286s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.798s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:45 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:45 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-e57ee788-42f7-4004-ab29-fed5724d59f4-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Creating offline snapshot 53983d94-23e5-4d15-86a1-639d704c310c of volume 420e8906-5991-416a-b57a-6bb831548e22 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94406083-cfcb-49f1-994d-27bfd326a35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19cd9332-4896-472d-aa5c-301153333f65', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8bacdf-2f9f-4c98-82e5-b977e005e1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Lock "cinder-e57ee788-42f7-4004-ab29-fed5724d59f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cf63ba-4460-4ba9-add4-1873669cbb44]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:45 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Volume volume-19cd9332-4896-472d-aa5c-301153333f65 (19cd9332-4896-472d-aa5c-301153333f65): created successfully Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8bacdf-2f9f-4c98-82e5-b977e005e1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Flow 'volume_create_manager' (43a2e34b-ab88-42b8-995c-a08cd842995d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" acquired by "delete_snapshot" :: waited 0.083s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-e57ee788-42f7-4004-ab29-fed5724d59f4" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a4f9f445-4f59-49ee-9f0e-f04e271f553c tempest-ProjectReaderTests-390922480 None] Created volume successfully. Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-e57ee788-42f7-4004-ab29-fed5724d59f4" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Deleting offline snapshot e57ee788-42f7-4004-ab29-fed5724d59f4 of volume 0f8043b8-dc20-411b-b79c-3b0632bd8ba4 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] snapshot_file for this snap is: volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:58:45 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 Sep 05 04:58:45 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Acquiring lock "cinder-c7090860-91a2-40f6-ad44-2daefe12b2b5-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eac8b00-4222-420d-954f-39d0beb0e277]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Lock "cinder-c7090860-91a2-40f6-ad44-2daefe12b2b5-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:45 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Acquiring lock "cinder-quobyte-c7090860-91a2-40f6-ad44-2daefe12b2b5" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:45 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Deleted volume successfully. Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-64a5f154-448e-4cd6-9bfc-155d3eee0e6f tempest-CinderUnicodeTest-710279916 None] Lock "cinder-df707b5c-332a-447e-9281-128686977dd0-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Lock "cinder-quobyte-c7090860-91a2-40f6-ad44-2daefe12b2b5" acquired by "delete_volume" :: waited 0.042s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[67274c8b-36ee-4544-8b24-53833eab609b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:45 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 Sep 05 04:58:45 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:45 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5 Sep 05 04:58:45 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:45 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22" returned: 0 in 0.539s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:45 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c 1G Sep 05 04:58:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:45 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4" returned: 0 in 0.541s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f7de01-b8c6-4724-b349-c51a8c18fa1e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:46 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5" returned: 0 in 0.418s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:46 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5 Sep 05 04:58:46 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 Sep 05 04:58:46 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c 1G" returned: 0 in 0.424s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420e8906-5991-416a-b57a-6bb831548e22 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:46 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420e8906-5991-416a-b57a-6bb831548e22 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c Sep 05 04:58:46 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-c7090860-91a2-40f6-ad44-2daefe12b2b5" returned: 0 in 0.281s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Lock "cinder-quobyte-c7090860-91a2-40f6-ad44-2daefe12b2b5" released by "delete_volume" :: held 0.742s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Created reservations ['3a4853dc-55c6-44bb-b5a6-254f302f9696', 'f3819868-7e67-4469-8f5f-636d7464785c', 'af3e20d9-9751-4753-84fd-5f0cc4a72367', '095c0243-dd71-4f78-a7f8-45a9fd035de2'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:46 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" returned: 0 in 0.428s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:46 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 Sep 05 04:58:46 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:46 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:46 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420e8906-5991-416a-b57a-6bb831548e22 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c" returned: 0 in 0.342s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c is being set with open permissions: ugo+rw Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:46 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c Sep 05 04:58:46 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.309s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Deleted volume successfully. Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-ec686e71-dca4-4e95-a677-3ade728f4c88 tempest-CinderUnicodeTest-710279916 None] Lock "cinder-c7090860-91a2-40f6-ad44-2daefe12b2b5-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:46 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4" returned: 0 in 0.430s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:46 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4 Sep 05 04:58:46 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:46 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c" returned: 0 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:47 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.info Sep 05 04:58:47 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:47 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4.e57ee788-42f7-4004-ab29-fed5724d59f4" returned: 0 in 0.298s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-e57ee788-42f7-4004-ab29-fed5724d59f4" released by "_delete_snapshot" :: held 1.851s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" released by "delete_snapshot" :: held 1.907s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:47 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.info" returned: 0 in 0.288s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:47 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.info is being set with open permissions: ugo+rw Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:47 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.info Sep 05 04:58:47 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Created reservations ['621ccc4a-3303-4d5e-8248-0169a628b265', '38f291f1-12bf-4e84-b5aa-11585ff2e24e', 'ec1ea052-cff0-4cc5-9eb7-5941dc5435fa', 'a0edd250-f7e2-4f8f-8a7c-150116a7c4fa'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:47 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Delete snapshot completed successfully. Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4dca7314-0223-4767-bd6b-d484df290e71 tempest-ProjectMemberTests-181407164 None] Lock "cinder-e57ee788-42f7-4004-ab29-fed5724d59f4-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:47 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.info" returned: 0 in 0.324s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.770s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Creating offline snapshot 9edfea1b-1738-41f2-af12-dda702cc2957 of volume 19cd9332-4896-472d-aa5c-301153333f65 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:58:47 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a5e8fa2a-0b7c-4458-b350-a221e3bfb226 tempest-CreateVolumesFromSnapshotTest-832519806 None] Create snapshot completed successfully Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81b41f9-3d83-4617-807c-6c64eae49896]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:47 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 Sep 05 04:58:47 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:48 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65" returned: 0 in 0.450s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:48 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 1G Sep 05 04:58:48 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-0f8043b8-dc20-411b-b79c-3b0632bd8ba4-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Lock "cinder-0f8043b8-dc20-411b-b79c-3b0632bd8ba4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:48 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:48 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[238b4556-c328-4160-b2d8-33f6f34c3c2d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:48 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 1G" returned: 0 in 0.554s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19cd9332-4896-472d-aa5c-301153333f65 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:48 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19cd9332-4896-472d-aa5c-301153333f65 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 Sep 05 04:58:48 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:48 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 Sep 05 04:58:48 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:49 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19cd9332-4896-472d-aa5c-301153333f65 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957" returned: 0 in 0.430s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:49 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 is being set with open permissions: ugo+rw Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:49 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" returned: 0 in 0.530s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:49 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 Sep 05 04:58:49 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:49 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4 Sep 05 04:58:49 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (49898eae-4b03-4655-a096-8503dcf2f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6146bc4-e977-406b-b315-6579d70a5cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6146bc4-e977-406b-b315-6579d70a5cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1921483563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9581ca-b2f9-44f8-a1af-5ba416b97527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:49Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60791ad8-d6e3-4b3f-852f-2aa29e6c72ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60791ad8-d6e3-4b3f-852f-2aa29e6c72ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ab6006-4198-4765-954f-16b2c71697c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ab6006-4198-4765-954f-16b2c71697c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9581ca-b2f9-44f8-a1af-5ba416b97527', 'volume_name': 'volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7928c482-808d-4fa0-90ba-0d1027d0609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7928c482-808d-4fa0-90ba-0d1027d0609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11cc7a15-120d-4ce9-86df-13eb15c12398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:49 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume 9c9581ca-b2f9-44f8-a1af-5ba416b97527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527', 'volume_size': 1} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:49 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" returned: 0 in 0.381s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-0f8043b8-dc20-411b-b79c-3b0632bd8ba4" released by "delete_volume" :: held 0.993s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:49 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957" returned: 0 in 0.471s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:49 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.info Sep 05 04:58:49 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (9c81e284-0410-42fa-9a39-a8ac16e1d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebe6d5f-de0b-4b6e-9197-c53aa87c6c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebe6d5f-de0b-4b6e-9197-c53aa87c6c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1970062821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd35d16f-8e9a-4a30-b93b-366543ae7d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:50Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331c2eca-ede4-4804-8d1a-faa6e7b3fd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331c2eca-ede4-4804-8d1a-faa6e7b3fd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d4f8ac-41ba-447d-ae97-bbaa898760e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d4f8ac-41ba-447d-ae97-bbaa898760e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd35d16f-8e9a-4a30-b93b-366543ae7d33', 'volume_name': 'volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab15ba9-0da4-4d71-9623-f615ee22fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab15ba9-0da4-4d71-9623-f615ee22fe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f4a70c-e66e-4fec-a2cc-7e75f4a6a5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:49 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume bd35d16f-8e9a-4a30-b93b-366543ae7d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33', 'volume_size': 1} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Created reservations ['a87b1f37-2124-4dce-b3cf-6c8eb66710b0', 'ce1f5714-8b62-4888-8bf2-3f684aead602', 'bc1556ed-b38a-48c1-bbe0-e66bc756671a', 'af89cd0f-bf93-4497-a173-41898e79dfe6'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:50 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:50 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:50 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.info" returned: 0 in 0.434s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:50 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.info is being set with open permissions: ugo+rw Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:50 devstack sudo[109367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.info Sep 05 04:58:50 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (1ad34c50-46b0-4994-95cd-ad4fee2c4540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86aeaeb1-280e-4f63-b102-52157c035c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:50 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.450s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86aeaeb1-280e-4f63-b102-52157c035c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362548278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc66bf7-1c08-492c-954a-4ead9056885d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:50Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:50 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9873b55-a116-4b53-b948-3f9809f0dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9873b55-a116-4b53-b948-3f9809f0dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5702e571-3948-4cf8-9d8d-d653641bbd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5702e571-3948-4cf8-9d8d-d653641bbd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc66bf7-1c08-492c-954a-4ead9056885d', 'volume_name': 'volume-3cc66bf7-1c08-492c-954a-4ead9056885d', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6071d97-9e82-4a38-bcfa-2a719017608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6071d97-9e82-4a38-bcfa-2a719017608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4938b46-1529-407e-ba32-92eeecc21eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:50 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume 3cc66bf7-1c08-492c-954a-4ead9056885d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc66bf7-1c08-492c-954a-4ead9056885d', 'volume_size': 1} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.info" returned: 0 in 0.398s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:50 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Deleted volume successfully. Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1921483563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9581ca-b2f9-44f8-a1af-5ba416b97527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:49Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Creating volume 9c9581ca-b2f9-44f8-a1af-5ba416b97527 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:50 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:50 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527 1073741824 Sep 05 04:58:50 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-4f0c5f20-65af-44d0-bad2-05a9ce346bd4 tempest-ProjectMemberTests-181407164 None] Lock "cinder-0f8043b8-dc20-411b-b79c-3b0632bd8ba4-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:50 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-66f4f25b-8606-4eb2-bf4a-260efd258e44 tempest-ProjectReaderTests-390922480 None] Create snapshot completed successfully Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (e7b4aeb6-0462-40c7-8bcd-4d09b892e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c4d4e9-a514-4a1b-8f01-f2701b609b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c4d4e9-a514-4a1b-8f01-f2701b609b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1560650932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364bc382-d4bc-40b7-9d40-951c527fa8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:51Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46271df7-53c0-4d84-8430-85422a6a724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46271df7-53c0-4d84-8430-85422a6a724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32575a4a-a72d-47d8-a01c-38b79883239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32575a4a-a72d-47d8-a01c-38b79883239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364bc382-d4bc-40b7-9d40-951c527fa8d2', 'volume_name': 'volume-364bc382-d4bc-40b7-9d40-951c527fa8d2', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c709322a-82c8-4500-8239-bfd9183399c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c709322a-82c8-4500-8239-bfd9183399c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865e9aca-d5a7-4e57-b6ca-406af758b0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:50 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume 364bc382-d4bc-40b7-9d40-951c527fa8d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364bc382-d4bc-40b7-9d40-951c527fa8d2', 'volume_size': 1} Sep 05 04:58:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (a157a441-34f3-4773-a336-7275b5a54829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ee72c5-eafd-48e0-9ded-4290b8dc285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ee72c5-eafd-48e0-9ded-4290b8dc285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1893835833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f60f7e-b3b8-4bd9-900f-c2681ff83835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:51Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e444752c-2350-431d-b0de-f2f775a70d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e444752c-2350-431d-b0de-f2f775a70d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a408067-5947-4495-9314-b10dac02b6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a408067-5947-4495-9314-b10dac02b6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f60f7e-b3b8-4bd9-900f-c2681ff83835', 'volume_name': 'volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafcbeb6-df3d-4391-b53a-42532dbf75e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafcbeb6-df3d-4391-b53a-42532dbf75e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c5dfb6-1572-4181-b2d9-d3103defda6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume f4f60f7e-b3b8-4bd9-900f-c2681ff83835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835', 'volume_size': 1} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:51 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527 1073741824" returned: 0 in 0.719s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:51 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527 Sep 05 04:58:51 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-9edfea1b-1738-41f2-af12-dda702cc2957-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Lock "cinder-9edfea1b-1738-41f2-af12-dda702cc2957-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-19cd9332-4896-472d-aa5c-301153333f65" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-19cd9332-4896-472d-aa5c-301153333f65" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-9edfea1b-1738-41f2-af12-dda702cc2957" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-9edfea1b-1738-41f2-af12-dda702cc2957" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Deleting offline snapshot 9edfea1b-1738-41f2-af12-dda702cc2957 of volume 19cd9332-4896-472d-aa5c-301153333f65 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] snapshot_file for this snap is: volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4102501-de0d-427c-8780-2862ddb07aae]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:51 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527" returned: 0 in 0.352s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1970062821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd35d16f-8e9a-4a30-b93b-366543ae7d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:50Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Creating volume bd35d16f-8e9a-4a30-b93b-366543ae7d33 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:51 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:51 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33 1073741824 Sep 05 04:58:51 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11cc7a15-120d-4ce9-86df-13eb15c12398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483e2e65-dac8-4d2f-9b45-73fb19625e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:51 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 Sep 05 04:58:51 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (8771cd7f-f56b-4fb9-9804-2ff874a92ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6911a31f-54ca-4079-897b-ec74f8d7d88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527 (9c9581ca-b2f9-44f8-a1af-5ba416b97527): created successfully Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483e2e65-dac8-4d2f-9b45-73fb19625e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (49898eae-4b03-4655-a096-8503dcf2f457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6911a31f-54ca-4079-897b-ec74f8d7d88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710065132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c3bf3c-66b5-4f61-9e94-5889280bb6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:52Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a82a4f-8efe-4a64-ac2e-e7f89b3a5451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a82a4f-8efe-4a64-ac2e-e7f89b3a5451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2afe77-21f2-4793-b97e-4a07d9e4f727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2afe77-21f2-4793-b97e-4a07d9e4f727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15c3bf3c-66b5-4f61-9e94-5889280bb6a1', 'volume_name': 'volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9365910-015d-4ad3-959f-4ee64056e094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9365910-015d-4ad3-959f-4ee64056e094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b3ef0f-f68d-479d-91c5-b88965b57655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:51 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Volume 15c3bf3c-66b5-4f61-9e94-5889280bb6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1', 'volume_size': 1} Sep 05 04:58:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:51 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e8711cbb-6d6b-424d-af43-6dd3a86550f9 tempest-CreateVolumesFromSnapshotTest-832519806 None] Created volume successfully. Sep 05 04:58:52 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957" returned: 0 in 0.544s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19cd9332-4896-472d-aa5c-301153333f65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[99443207-4e70-4db0-81d9-e3b0ec0cd3c5]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:52 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33 1073741824" returned: 0 in 0.569s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:52 devstack sudo[109390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 Sep 05 04:58:52 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:52 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33 Sep 05 04:58:52 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:52 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33" returned: 0 in 0.311s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.105s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362548278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc66bf7-1c08-492c-954a-4ead9056885d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:50Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Creating volume 3cc66bf7-1c08-492c-954a-4ead9056885d {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:52 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:52 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65" returned: 0 in 0.465s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:52 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d 1073741824 Sep 05 04:58:52 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f4a70c-e66e-4fec-a2cc-7e75f4a6a5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49bab3b-ab37-48fc-b96d-98a5fcb5de18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:52 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 Sep 05 04:58:52 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:52 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33 (bd35d16f-8e9a-4a30-b93b-366543ae7d33): created successfully Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49bab3b-ab37-48fc-b96d-98a5fcb5de18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (9c81e284-0410-42fa-9a39-a8ac16e1d138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e3381480-c9bf-4d9e-bf8b-c2bcf06c7aec tempest-CreateVolumesFromSnapshotTest-832519806 None] Created volume successfully. Sep 05 04:58:53 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:53 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957 Sep 05 04:58:53 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:53 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d 1073741824" returned: 0 in 0.492s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:53 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d Sep 05 04:58:53 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:53 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65.9edfea1b-1738-41f2-af12-dda702cc2957" returned: 0 in 0.282s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-9edfea1b-1738-41f2-af12-dda702cc2957" released by "_delete_snapshot" :: held 1.850s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-19cd9332-4896-472d-aa5c-301153333f65" released by "delete_snapshot" :: held 1.883s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Created reservations ['3e645751-8229-4e00-957b-194bf8f190c5', '7a83702e-765b-4765-8f6a-d8453b6230b6', '72bf4b73-c898-4566-ba21-f04c5023e580', '021e3bbb-e19d-41ed-a5e9-b20bb5279459'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:53 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d" returned: 0 in 0.330s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.654s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1560650932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364bc382-d4bc-40b7-9d40-951c527fa8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:51Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Creating volume 364bc382-d4bc-40b7-9d40-951c527fa8d2 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:53 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:53 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2 1073741824 Sep 05 04:58:53 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4938b46-1529-407e-ba32-92eeecc21eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc66bf7-1c08-492c-954a-4ead9056885d', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ff6c22-8778-443e-9fef-14b5bdea6d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Delete snapshot completed successfully. Sep 05 04:58:53 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume volume-3cc66bf7-1c08-492c-954a-4ead9056885d (3cc66bf7-1c08-492c-954a-4ead9056885d): created successfully Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ff6c22-8778-443e-9fef-14b5bdea6d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (1ad34c50-46b0-4994-95cd-ad4fee2c4540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-6960fcf0-a038-4760-b79a-d8d9c2e5493e tempest-ProjectReaderTests-390922480 None] Lock "cinder-9edfea1b-1738-41f2-af12-dda702cc2957-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:53 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d91a7925-84a0-4e4c-8ce1-d47b3d595711 tempest-CreateVolumesFromSnapshotTest-832519806 None] Created volume successfully. Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-19cd9332-4896-472d-aa5c-301153333f65-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Lock "cinder-19cd9332-4896-472d-aa5c-301153333f65-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-19cd9332-4896-472d-aa5c-301153333f65" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-19cd9332-4896-472d-aa5c-301153333f65" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba96fa3-c26a-4b79-a9ee-8ae1168585cb]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:53 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 Sep 05 04:58:53 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:54 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2 1073741824" returned: 0 in 0.555s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:54 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2 Sep 05 04:58:54 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:54 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65" returned: 0 in 0.442s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:54 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65 Sep 05 04:58:54 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:54 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2" returned: 0 in 0.273s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.166s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1893835833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f60f7e-b3b8-4bd9-900f-c2681ff83835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c0b7f84104c89a76e42734a956138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:51Z,use_quota=True,user_id='4b0cf463670f430ebdd652c395fdea6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Creating volume f4f60f7e-b3b8-4bd9-900f-c2681ff83835 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:54 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865e9aca-d5a7-4e57-b6ca-406af758b0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364bc382-d4bc-40b7-9d40-951c527fa8d2', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0f95a9-a125-4787-9cf3-69f91fc3742d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:54 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835 1073741824 Sep 05 04:58:54 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:54 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume volume-364bc382-d4bc-40b7-9d40-951c527fa8d2 (364bc382-d4bc-40b7-9d40-951c527fa8d2): created successfully Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0f95a9-a125-4787-9cf3-69f91fc3742d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (e7b4aeb6-0462-40c7-8bcd-4d09b892e070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:54 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1846766f-85c4-4af6-8735-e7cd4e16ff2b tempest-CreateVolumesFromSnapshotTest-832519806 None] Created volume successfully. Sep 05 04:58:54 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-19cd9332-4896-472d-aa5c-301153333f65" returned: 0 in 0.344s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-19cd9332-4896-472d-aa5c-301153333f65" released by "delete_volume" :: held 0.867s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Created reservations ['0c544f67-632b-4b85-8b54-33cffa69d73c', 'e101c016-ee58-4d4c-8396-b3dd010da02b', 'ac8e9007-901c-4c75-b1a3-a6e8ad466f34', '7c48c8c9-1be3-4069-9cd5-1ae5c2c83b65'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:54 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:54 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:54 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835 1073741824" returned: 0 in 0.638s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:55 devstack sudo[109440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835 Sep 05 04:58:55 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:55 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.322s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:55 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Deleted volume successfully. Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3f681b4c-ae3c-483a-be2a-b7714d5ba307 tempest-ProjectReaderTests-390922480 None] Lock "cinder-19cd9332-4896-472d-aa5c-301153333f65-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:55 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835" returned: 0 in 0.314s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.544s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710065132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c3bf3c-66b5-4f61-9e94-5889280bb6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:52Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Creating volume 15c3bf3c-66b5-4f61-9e94-5889280bb6a1 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:55 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c5dfb6-1572-4181-b2d9-d3103defda6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:55 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 1073741824 Sep 05 04:58:55 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98ba644-4a96-43f7-864d-d4b5c0abd8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=219,cinder:UPDATE=279,cinder:INSERT=69,cinder:DELETE=23 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:58:55 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Volume volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835 (f4f60f7e-b3b8-4bd9-900f-c2681ff83835): created successfully Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98ba644-4a96-43f7-864d-d4b5c0abd8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Flow 'volume_create_manager' (a157a441-34f3-4773-a336-7275b5a54829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:55 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0cfba531-d6eb-4582-bc01-f2c7f82d7eae tempest-CreateVolumesFromSnapshotTest-832519806 None] Created volume successfully. Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Flow 'volume_create_manager' (0d43b287-27d0-4a83-b3fe-771b0e72a6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a069ee9-4692-428a-b028-0c1b012f828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a069ee9-4692-428a-b028-0c1b012f828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673577622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffdabb8-fa8d-4acf-9425-b7c76ea27510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4873896f73a84ffc9f852ad1e2000a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:55Z,use_quota=True,user_id='3243fb5bb12d4bb7828ce16f18d4331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a906af1-c81e-4ac0-b867-cedcf156f360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a906af1-c81e-4ac0-b867-cedcf156f360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc95e76-7a72-459a-a4c1-cfe95e0138e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc95e76-7a72-459a-a4c1-cfe95e0138e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ffdabb8-fa8d-4acf-9425-b7c76ea27510', 'volume_name': 'volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1bbc68-7a6f-470c-9fdf-ac1f37be87cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1bbc68-7a6f-470c-9fdf-ac1f37be87cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15eca7f-e99a-41db-b169-8a314d49155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:55 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Volume 3ffdabb8-fa8d-4acf-9425-b7c76ea27510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510', 'volume_size': 1} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-f4f60f7e-b3b8-4bd9-900f-c2681ff83835-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-f4f60f7e-b3b8-4bd9-900f-c2681ff83835-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=279,cinder:SELECT=205,cinder:DELETE=29,cinder:INSERT=82 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-quobyte-f4f60f7e-b3b8-4bd9-900f-c2681ff83835" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-f4f60f7e-b3b8-4bd9-900f-c2681ff83835" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e61411e-430d-4fdc-b7c0-60a7789b71c9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:55 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 1073741824" returned: 0 in 0.569s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:56 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 Sep 05 04:58:56 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:56 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835 Sep 05 04:58:56 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:56 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" returned: 0 in 0.275s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673577622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffdabb8-fa8d-4acf-9425-b7c76ea27510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4873896f73a84ffc9f852ad1e2000a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:55Z,use_quota=True,user_id='3243fb5bb12d4bb7828ce16f18d4331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Creating volume 3ffdabb8-fa8d-4acf-9425-b7c76ea27510 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:56 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b3ef0f-f68d-479d-91c5-b88965b57655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204dbf84-7045-408a-a616-c61d72f18933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:56 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:56 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 1073741824 Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835" returned: 0 in 0.395s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:56 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:56 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Volume volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 (15c3bf3c-66b5-4f61-9e94-5889280bb6a1): created successfully Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204dbf84-7045-408a-a616-c61d72f18933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (8771cd7f-f56b-4fb9-9804-2ff874a92ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:56 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835 Sep 05 04:58:56 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:56 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-41d7d3eb-bdb7-47f3-874a-593ba642d6ab tempest-ProjectMemberTests-181407164 None] Created volume successfully. Sep 05 04:58:56 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-f4f60f7e-b3b8-4bd9-900f-c2681ff83835" returned: 0 in 0.297s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-f4f60f7e-b3b8-4bd9-900f-c2681ff83835" released by "delete_volume" :: held 0.742s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Created reservations ['e4f7b384-230b-4517-8b7e-0bd3188800ce', '32a30b5b-57d4-40dd-ba43-b2c670538aba', 'd26516a0-9586-43f9-9e88-cbd41e40ba49', 'f75a9888-c6bb-4bbb-aa84-38a3f65a652b'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:56 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 1073741824" returned: 0 in 0.510s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:56 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:56 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:56 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 Sep 05 04:58:56 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:57 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.372s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Deleted volume successfully. Sep 05 04:58:57 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" returned: 0 in 0.341s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.020s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-364bc382-d4bc-40b7-9d40-951c527fa8d2-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15eca7f-e99a-41db-b169-8a314d49155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcac7b18-b6a6-4606-bcb4-dd5d2711f608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Creating offline snapshot 1e3b2a91-75de-453b-8dcf-46dd781e8e14 of volume 15c3bf3c-66b5-4f61-9e94-5889280bb6a1 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1998a881-9c1e-436c-926d-c048744918f0 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-f4f60f7e-b3b8-4bd9-900f-c2681ff83835-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-364bc382-d4bc-40b7-9d40-951c527fa8d2-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:57 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Volume volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 (3ffdabb8-fa8d-4acf-9425-b7c76ea27510): created successfully Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcac7b18-b6a6-4606-bcb4-dd5d2711f608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Flow 'volume_create_manager' (0d43b287-27d0-4a83-b3fe-771b0e72a6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[38938ca1-2c95-44b6-9078-d417d4227760]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:57 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-924881d5-a112-4221-9702-d08c8d046ef2 tempest-ProjectReaderTests-390922480 None] Created volume successfully. Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-quobyte-364bc382-d4bc-40b7-9d40-951c527fa8d2" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-364bc382-d4bc-40b7-9d40-951c527fa8d2" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1616dbce-94bc-4ca1-9265-22b777340ba7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:57 devstack sudo[109474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 Sep 05 04:58:57 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Flow 'volume_create_manager' (842efd7c-8088-4ee6-9f7c-131cbcd0886e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ecf6d4-679d-4435-aadf-d9aa09b35034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ecf6d4-679d-4435-aadf-d9aa09b35034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282825540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cfdc1023649aa89846032daaffbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:57Z,use_quota=True,user_id='2eb835ee02ab4e95a0f375119693d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d685ffb2-863b-46eb-9b3f-22ea85801b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:57 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2 Sep 05 04:58:57 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d685ffb2-863b-46eb-9b3f-22ea85801b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9608da8b-695f-49d3-8326-34624c6ff95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9608da8b-695f-49d3-8326-34624c6ff95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7', 'volume_name': 'volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e0617a-24bd-4a9c-92d5-a6139fb0f2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e0617a-24bd-4a9c-92d5-a6139fb0f2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f806233-4c06-4de5-8eb0-3cc02f7167f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:58:57 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Volume 3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7', 'volume_size': 1} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:57 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" returned: 0 in 0.448s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:57 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 1G Sep 05 04:58:57 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:57 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2" returned: 0 in 0.417s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:57 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2 Sep 05 04:58:57 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:58 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-364bc382-d4bc-40b7-9d40-951c527fa8d2" returned: 0 in 0.261s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-364bc382-d4bc-40b7-9d40-951c527fa8d2" released by "delete_volume" :: held 0.721s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:58 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Created reservations ['c3b39621-48fa-49f4-ba15-0dfac2ced63a', 'd21e5bea-02e5-48a6-9db1-ad11d8d9e992', '05c11523-e032-4586-9c18-f37a8d799b1b', '5a8a7665-ad4b-4b88-93fa-886f2fd71e7e'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 1G" returned: 0 in 0.415s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:58 devstack sudo[109492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 Sep 05 04:58:58 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:58 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:58 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-3cc66bf7-1c08-492c-954a-4ead9056885d-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-3cc66bf7-1c08-492c-954a-4ead9056885d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-quobyte-3cc66bf7-1c08-492c-954a-4ead9056885d" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-3cc66bf7-1c08-492c-954a-4ead9056885d" acquired by "delete_volume" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:58 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14" returned: 0 in 0.353s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:58 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 is being set with open permissions: ugo+rw Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c909717-9053-479d-80b4-15a1abd0c5cb]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:58 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:58 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 Sep 05 04:58:58 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.300s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:58 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Deleted volume successfully. Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-18eeb798-bedf-4276-83ac-04b0dc71de30 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-364bc382-d4bc-40b7-9d40-951c527fa8d2-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:58 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d Sep 05 04:58:58 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:58 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14" returned: 0 in 0.274s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:58 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.info Sep 05 04:58:58 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:58 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d" returned: 0 in 0.387s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:58 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d Sep 05 04:58:58 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:59 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.info" returned: 0 in 0.262s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:59 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.info is being set with open permissions: ugo+rw Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:59 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.info Sep 05 04:58:59 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:59 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3cc66bf7-1c08-492c-954a-4ead9056885d" returned: 0 in 0.260s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-3cc66bf7-1c08-492c-954a-4ead9056885d" released by "delete_volume" :: held 0.698s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Created reservations ['37922024-b110-4e32-86f9-707cd800ae0f', '0d906da6-372a-4f3c-a545-892af4c5d31c', '3ae69006-cd55-4367-a6cc-2afa7de601a2', '775b8223-175e-41a5-a2ed-c4b868ddac1d'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:59 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:58:59 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:59 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.info" returned: 0 in 0.278s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282825540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cfdc1023649aa89846032daaffbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:58:57Z,use_quota=True,user_id='2eb835ee02ab4e95a0f375119693d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Creating volume 3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:58:59 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:59 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 1073741824 Sep 05 04:58:59 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:59 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-93705dc2-748a-4de2-b898-d684fcec2155 tempest-ProjectMemberTests-181407164 None] Create snapshot completed successfully Sep 05 04:58:59 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.259s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:58:59 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Deleted volume successfully. Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-bd35d16f-8e9a-4a30-b93b-366543ae7d33-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a3008f23-941e-4044-b2c7-59053a995703 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-3cc66bf7-1c08-492c-954a-4ead9056885d-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-bd35d16f-8e9a-4a30-b93b-366543ae7d33-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-quobyte-bd35d16f-8e9a-4a30-b93b-366543ae7d33" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-bd35d16f-8e9a-4a30-b93b-366543ae7d33" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a787b-6879-4646-b063-44d83ce64fc8]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:59 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33 Sep 05 04:58:59 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:58:59 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 1073741824" returned: 0 in 0.473s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:58:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:58:59 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 Sep 05 04:58:59 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:00 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33" returned: 0 in 0.370s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:00 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33 Sep 05 04:59:00 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:00 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7" returned: 0 in 0.255s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.407s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f806233-4c06-4de5-8eb0-3cc02f7167f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7038148e-b09d-4249-8df8-83bc4e6c9c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Creating offline snapshot 5354c850-e803-407e-9290-0b695c4e6a8f of volume 3ffdabb8-fa8d-4acf-9425-b7c76ea27510 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:59:00 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Volume volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 (3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7): created successfully Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7038148e-b09d-4249-8df8-83bc4e6c9c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Flow 'volume_create_manager' (842efd7c-8088-4ee6-9f7c-131cbcd0886e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e48032-1c95-4b26-9d9e-1cf7c92b2b0e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:00 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-15937f2d-cfde-47a5-aaf7-a66e52b89434 tempest-ProjectReaderTests-2128575756 None] Created volume successfully. Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-1e3b2a91-75de-453b-8dcf-46dd781e8e14-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Lock "cinder-1e3b2a91-75de-453b-8dcf-46dd781e8e14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-1e3b2a91-75de-453b-8dcf-46dd781e8e14" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-1e3b2a91-75de-453b-8dcf-46dd781e8e14" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Deleting offline snapshot 1e3b2a91-75de-453b-8dcf-46dd781e8e14 of volume 15c3bf3c-66b5-4f61-9e94-5889280bb6a1 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] snapshot_file for this snap is: volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:00 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-bd35d16f-8e9a-4a30-b93b-366543ae7d33" returned: 0 in 0.301s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[555f453f-d009-4a94-98ce-161a9146d439]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:00 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 Sep 05 04:59:00 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-bd35d16f-8e9a-4a30-b93b-366543ae7d33" released by "delete_volume" :: held 0.722s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Created reservations ['ec5395c1-0a6c-4e73-8e4b-c49a234947c0', '35c73da7-7d28-457c-9513-f167e3cbbe40', '3008f5ee-46d5-42e9-ad6a-f7cf0de0b907', 'd90d2dcf-aba0-4ac4-84d1-25b14bf37ca5'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:00 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 Sep 05 04:59:00 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:00 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:00 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:00 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" returned: 0 in 0.427s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:00 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f 1G Sep 05 04:59:00 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:00 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.287s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-9c9581ca-b2f9-44f8-a1af-5ba416b97527-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:00 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Deleted volume successfully. Sep 05 04:59:00 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14" returned: 0 in 0.500s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-9c9581ca-b2f9-44f8-a1af-5ba416b97527-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1863da-4b19-4aed-bce0-07080bc0509c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-abf7d6e5-f1b1-464b-9899-2e9c96f82dcf tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-bd35d16f-8e9a-4a30-b93b-366543ae7d33-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "cinder-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-quobyte-9c9581ca-b2f9-44f8-a1af-5ba416b97527" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Lock "cinder-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-9c9581ca-b2f9-44f8-a1af-5ba416b97527" acquired by "delete_volume" :: waited 0.040s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddecf6eb-3d0a-48cd-8a6b-354aeb0b073e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:01 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 Sep 05 04:59:01 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "cinder-quobyte-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Lock "cinder-quobyte-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc74c260-05d2-434a-a955-8d58771efa1c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:01 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527 Sep 05 04:59:01 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:01 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f 1G" returned: 0 in 0.573s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:01 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 Sep 05 04:59:01 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:01 devstack sudo[109561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f Sep 05 04:59:01 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:01 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" returned: 0 in 0.479s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:01 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 Sep 05 04:59:01 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:01 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527" returned: 0 in 0.460s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:01 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527 Sep 05 04:59:01 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:01 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7" returned: 0 in 0.422s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:01 devstack sudo[109580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7 Sep 05 04:59:01 devstack sudo[109580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:01 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f" returned: 0 in 0.397s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:01 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f is being set with open permissions: ugo+rw Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:01 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f Sep 05 04:59:01 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:01 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-9c9581ca-b2f9-44f8-a1af-5ba416b97527" returned: 0 in 0.277s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:01 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14" returned: 0 in 0.407s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-9c9581ca-b2f9-44f8-a1af-5ba416b97527" released by "delete_volume" :: held 0.812s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:01 devstack sudo[109591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14 Sep 05 04:59:01 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:01 devstack sudo[109580]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7" returned: 0 in 0.292s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Lock "cinder-quobyte-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7" released by "delete_volume" :: held 0.770s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:01 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Created reservations ['eee24711-88eb-4822-b776-d49ac0f01208', 'dda90b0b-6161-4c8c-9be4-8bb9cf92e08a', '9b5034e0-3a44-44cb-becc-c396db852dd8', '9ae9af3d-7e27-4539-ad04-a84289d2e521'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f" returned: 0 in 0.319s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Created reservations ['f62a407d-bc4b-40f0-8cdf-7a0e359dcbfa', '3d0d9e3d-ca89-4ae1-94aa-b4c1c912f147', 'b75ac2c1-5c39-4a8c-8954-f3e9322afbb4', '07efce8f-cf7a-491b-86d0-0e79f77653db'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:02 devstack sudo[109594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.info Sep 05 04:59:02 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:02 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1.1e3b2a91-75de-453b-8dcf-46dd781e8e14" returned: 0 in 0.356s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:02 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:02 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-1e3b2a91-75de-453b-8dcf-46dd781e8e14" released by "_delete_snapshot" :: held 1.893s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" released by "delete_snapshot" :: held 1.936s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:02 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:02 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:02 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.info" returned: 0 in 0.368s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:02 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.info is being set with open permissions: ugo+rw Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Created reservations ['9a121599-f87a-4c84-bd2a-badda5ef6431', '406e7851-6b56-46b7-91f6-9d73d0fbd244', 'eb50b082-a971-409b-9540-c60c43d05606', 'd6ece34d-3943-47d9-b4f6-b5cfee367963'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:02 devstack sudo[109602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.info Sep 05 04:59:02 devstack sudo[109602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:02 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.372s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:02 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Delete snapshot completed successfully. Sep 05 04:59:02 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Deleted volume successfully. Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0adb63b9-f16b-4de9-955b-f25cba86178c tempest-ProjectMemberTests-181407164 None] Lock "cinder-1e3b2a91-75de-453b-8dcf-46dd781e8e14-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c94e5674-308a-43ac-b3d1-90b8b41762fe tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-9c9581ca-b2f9-44f8-a1af-5ba416b97527-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:02 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.423s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:02 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Deleted volume successfully. Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-105a3698-8c2e-4f72-a297-bfa81ce990a1 tempest-ProjectReaderTests-2128575756 None] Lock "cinder-3fab4aaa-79e0-4de9-973e-5d5b77b0a7f7-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:02 devstack sudo[109602]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.info" returned: 0 in 0.353s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:02 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-be26a971-2fe5-4d6b-b034-4a8a58b9f74a tempest-ProjectReaderTests-390922480 None] Create snapshot completed successfully Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Flow 'volume_create_manager' (47b36069-5658-4088-8dc6-261f15e81806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19261141-e1b8-4254-8625-7fe11a9882c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19261141-e1b8-4254-8625-7fe11a9882c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-764424900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5203e657-9231-4bd2-b26d-ab7fffe1a4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cfdc1023649aa89846032daaffbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:03Z,use_quota=True,user_id='2eb835ee02ab4e95a0f375119693d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a0719a-4055-4afe-b2e4-20e910e159b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a0719a-4055-4afe-b2e4-20e910e159b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca8cb71-9f12-46f8-97c9-38c84c3f7948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca8cb71-9f12-46f8-97c9-38c84c3f7948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5203e657-9231-4bd2-b26d-ab7fffe1a4f1', 'volume_name': 'volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6345ab-7234-4262-8f78-be24fbd51bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6345ab-7234-4262-8f78-be24fbd51bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7805d2b1-efaf-437f-acc4-45ea965aa3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:02 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Volume 5203e657-9231-4bd2-b26d-ab7fffe1a4f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1', 'volume_size': 1} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-764424900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5203e657-9231-4bd2-b26d-ab7fffe1a4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cfdc1023649aa89846032daaffbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:03Z,use_quota=True,user_id='2eb835ee02ab4e95a0f375119693d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Creating volume 5203e657-9231-4bd2-b26d-ab7fffe1a4f1 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:02 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:02 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:02 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1 1073741824 Sep 05 04:59:02 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-5354c850-e803-407e-9290-0b695c4e6a8f-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Lock "cinder-5354c850-e803-407e-9290-0b695c4e6a8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-5354c850-e803-407e-9290-0b695c4e6a8f" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-5354c850-e803-407e-9290-0b695c4e6a8f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Deleting offline snapshot 5354c850-e803-407e-9290-0b695c4e6a8f of volume 3ffdabb8-fa8d-4acf-9425-b7c76ea27510 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] snapshot_file for this snap is: volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-53983d94-23e5-4d15-86a1-639d704c310c-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ca559b-171a-4854-be48-a3c7c8aec9d5]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-53983d94-23e5-4d15-86a1-639d704c310c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-quobyte-420e8906-5991-416a-b57a-6bb831548e22" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-420e8906-5991-416a-b57a-6bb831548e22" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-quobyte-53983d94-23e5-4d15-86a1-639d704c310c" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-53983d94-23e5-4d15-86a1-639d704c310c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Deleting offline snapshot 53983d94-23e5-4d15-86a1-639d704c310c of volume 420e8906-5991-416a-b57a-6bb831548e22 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] snapshot_file for this snap is: volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adae14d-6ee2-47fc-ace4-004267438087]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:03 devstack sudo[109612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f Sep 05 04:59:03 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:03 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1 1073741824" returned: 0 in 0.468s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:03 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c Sep 05 04:59:03 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:03 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1 Sep 05 04:59:03 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:03 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f" returned: 0 in 0.440s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4aeb42-e1aa-4618-9a00-2b0c94e1fb22]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:03 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-15c3bf3c-66b5-4f61-9e94-5889280bb6a1-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c" returned: 0 in 0.415s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420e8906-5991-416a-b57a-6bb831548e22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Lock "cinder-15c3bf3c-66b5-4f61-9e94-5889280bb6a1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c712b-5456-4257-ae16-06dce77b50c6]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:03 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1" returned: 0 in 0.326s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7805d2b1-efaf-437f-acc4-45ea965aa3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfef18f-b484-4938-a18b-594a1fe01f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:03 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 Sep 05 04:59:03 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:03 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Volume volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1 (5203e657-9231-4bd2-b26d-ab7fffe1a4f1): created successfully Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfef18f-b484-4938-a18b-594a1fe01f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Flow 'volume_create_manager' (47b36069-5658-4088-8dc6-261f15e81806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:03 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4b186cb9-6b5e-401a-a1bf-c3d96530eda5 tempest-ProjectReaderTests-2128575756 None] Created volume successfully. Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" acquired by "delete_volume" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:03 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 Sep 05 04:59:03 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc351b9f-dd4d-4a83-873e-b25643d5702f]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:03 devstack sudo[109630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 Sep 05 04:59:03 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:04 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" returned: 0 in 0.434s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:04 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f Sep 05 04:59:04 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:04 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22" returned: 0 in 0.413s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:04 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c Sep 05 04:59:04 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:04 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" returned: 0 in 0.386s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:04 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1 Sep 05 04:59:04 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:04 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f" returned: 0 in 0.394s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:04 devstack sudo[109653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f Sep 05 04:59:04 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:04 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c" returned: 0 in 0.371s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:04 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c Sep 05 04:59:04 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:04 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" returned: 0 in 0.285s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-15c3bf3c-66b5-4f61-9e94-5889280bb6a1" released by "delete_volume" :: held 0.737s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Created reservations ['3a5323b8-2fef-4d8e-aba8-b1d05b3daaa0', '78d26f6e-2926-40a7-ba7f-61e9a26a8fb5', '54ddc316-ac00-4690-9001-41f7c7400eaa', '7d326504-30ce-44bc-8ba3-aab7d7364a00'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:04 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510.5354c850-e803-407e-9290-0b695c4e6a8f" returned: 0 in 0.269s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:04 devstack sudo[109660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:04 devstack sudo[109660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-5354c850-e803-407e-9290-0b695c4e6a8f" released by "_delete_snapshot" :: held 1.660s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" released by "delete_snapshot" :: held 1.689s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:04 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22.53983d94-23e5-4d15-86a1-639d704c310c" returned: 0 in 0.321s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-53983d94-23e5-4d15-86a1-639d704c310c" released by "_delete_snapshot" :: held 1.679s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Created reservations ['a85b5e86-a91e-435d-b027-8058a0a3e802', '717756c6-368a-4c63-b8ff-add88f753f3e', 'a17a0b96-ed92-49b9-a828-dc8afefb862b', 'a1527b2d-7bfe-4ed4-9502-af1b7a449cc8'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-420e8906-5991-416a-b57a-6bb831548e22" released by "delete_snapshot" :: held 1.713s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "cinder-5203e657-9231-4bd2-b26d-ab7fffe1a4f1-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:04 devstack sudo[109660]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:04 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Delete snapshot completed successfully. Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.342s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-743cc4d0-c913-4175-87c8-208d658eb429 tempest-ProjectReaderTests-390922480 None] Lock "cinder-5354c850-e803-407e-9290-0b695c4e6a8f-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Lock "cinder-5203e657-9231-4bd2-b26d-ab7fffe1a4f1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Deleted volume successfully. Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Created reservations ['88007563-275c-44c4-97a6-ff629708b3b8', '1173d63f-fa38-4fa7-bce6-85d203c0f1f1', '2d758dc0-14c5-4a1f-862d-1a8b58796278', '574ea4bb-4ca7-446e-81f5-86c630079a99'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5fb5e8b9-291e-4336-aa94-68c128d2d04f tempest-ProjectMemberTests-181407164 None] Lock "cinder-15c3bf3c-66b5-4f61-9e94-5889280bb6a1-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "cinder-quobyte-5203e657-9231-4bd2-b26d-ab7fffe1a4f1" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Lock "cinder-quobyte-5203e657-9231-4bd2-b26d-ab7fffe1a4f1" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:05 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Delete snapshot completed successfully. Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8388a098-bffd-44be-aab0-469e5e98adde tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-53983d94-23e5-4d15-86a1-639d704c310c-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5211a2e-610e-4b57-919e-7c0caae769b2]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-3ffdabb8-fa8d-4acf-9425-b7c76ea27510-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Lock "cinder-3ffdabb8-fa8d-4acf-9425-b7c76ea27510-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:05 devstack sudo[109664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1 Sep 05 04:59:05 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-420e8906-5991-416a-b57a-6bb831548e22-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-420e8906-5991-416a-b57a-6bb831548e22-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a21fa2-ac2e-450b-abcb-c9073b88ee7c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "cinder-quobyte-420e8906-5991-416a-b57a-6bb831548e22" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (b9a65ff1-51c4-4ab7-80b9-18173a1ba5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6deba68-9142-4445-95d0-94978f562266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-420e8906-5991-416a-b57a-6bb831548e22" acquired by "delete_volume" :: waited 0.054s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:05 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6deba68-9142-4445-95d0-94978f562266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745239693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafa47d3-0c61-4edb-97aa-5aafc4f862a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:05Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:05 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 Sep 05 04:59:05 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca23dcc2-af2e-4173-b24d-7f4e2b9c8890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca23dcc2-af2e-4173-b24d-7f4e2b9c8890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa9055e-4b20-4261-90f5-2c20b00c70c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa9055e-4b20-4261-90f5-2c20b00c70c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafa47d3-0c61-4edb-97aa-5aafc4f862a9', 'volume_name': 'volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3840d7ef-95db-4fc4-93be-de21e5e7d4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3840d7ef-95db-4fc4-93be-de21e5e7d4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e80d49-2f01-40e8-9d36-7511b92b74a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:05 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Volume dafa47d3-0c61-4edb-97aa-5aafc4f862a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9', 'volume_size': 1} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745239693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafa47d3-0c61-4edb-97aa-5aafc4f862a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:05Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Creating volume dafa47d3-0c61-4edb-97aa-5aafc4f862a9 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:05 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fa5936-e768-4387-90bb-698d53369956]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:05 devstack sudo[109671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 1073741824 Sep 05 04:59:05 devstack sudo[109671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1" returned: 0 in 0.520s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:05 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1 Sep 05 04:59:05 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:05 devstack sudo[109672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 Sep 05 04:59:05 devstack sudo[109672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:05 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" returned: 0 in 0.419s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:05 devstack sudo[109683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510 Sep 05 04:59:05 devstack sudo[109683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:05 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-5203e657-9231-4bd2-b26d-ab7fffe1a4f1" returned: 0 in 0.295s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Lock "cinder-quobyte-5203e657-9231-4bd2-b26d-ab7fffe1a4f1" released by "delete_volume" :: held 0.875s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Created reservations ['af6d56d5-31aa-41c0-b6c9-d92c2236b24f', '8f688d13-0b33-4ee8-86ab-427fcff1baa1', '3c4d0e2b-3cf5-458c-9677-13c9b08a369c', 'cda2d255-8733-4f76-a271-85102236c520'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:06 devstack sudo[109672]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22" returned: 0 in 0.435s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:06 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22 Sep 05 04:59:06 devstack sudo[109671]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:06 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 1073741824" returned: 0 in 0.512s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:06 devstack sudo[109695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:06 devstack sudo[109695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:06 devstack sudo[109697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 Sep 05 04:59:06 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:06 devstack sudo[109683]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" returned: 0 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-3ffdabb8-fa8d-4acf-9425-b7c76ea27510" released by "delete_volume" :: held 0.911s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Created reservations ['617d054a-4d22-4942-a3f5-da4b89b14f46', '764a8f12-f8b0-43c5-9a17-56ac4ed52462', '6caa07e9-f047-4333-a893-3aebe2594754', 'ad2849d5-62be-45dd-833c-713cbba4056e'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:06 devstack sudo[109695]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.317s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:06 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Deleted volume successfully. Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-420e8906-5991-416a-b57a-6bb831548e22" returned: 0 in 0.442s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-quobyte-420e8906-5991-416a-b57a-6bb831548e22" released by "delete_volume" :: held 1.013s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3594b22c-57fc-4260-a2dc-7f64239a6bf5 tempest-ProjectReaderTests-2128575756 None] Lock "cinder-5203e657-9231-4bd2-b26d-ab7fffe1a4f1-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:06 devstack sudo[109702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:06 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:06 devstack sudo[109702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" returned: 0 in 0.432s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e80d49-2f01-40e8-9d36-7511b92b74a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9144a2-bd54-420d-9ab4-fa9e2edef78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Created reservations ['cb0b228f-0bbb-4b57-8f1b-c1fd94445f13', '4cd2fa93-e486-4b63-914e-ad4b3d9d2130', '5e615343-7a51-40cd-907a-03a91137d426', '80fc5b52-2eb6-416c-9115-81b633a9eee5'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:06 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Volume volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 (dafa47d3-0c61-4edb-97aa-5aafc4f862a9): created successfully Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9144a2-bd54-420d-9ab4-fa9e2edef78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (b9a65ff1-51c4-4ab7-80b9-18173a1ba5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-dd4442ee-eeba-4948-a692-6a61ab0d982d tempest-ProjectMemberTests-181407164 None] Created volume successfully. Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:06 devstack sudo[109704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:06 devstack sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:06 devstack sudo[109702]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.325s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Flow 'volume_create_manager' (abab3d1b-7ca3-481b-bc52-a06ebca2262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03acbf2e-ca67-4a5f-be67-307fafb0aa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Deleted volume successfully. Sep 05 04:59:06 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03acbf2e-ca67-4a5f-be67-307fafb0aa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-298644541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2333e7-b337-478e-8692-fc568aafdbe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cfdc1023649aa89846032daaffbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:07Z,use_quota=True,user_id='2eb835ee02ab4e95a0f375119693d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa315189-c3d8-4b2d-870f-8345bc7d527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa315189-c3d8-4b2d-870f-8345bc7d527f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037b15c9-0da9-46c2-9eed-7632900c46a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037b15c9-0da9-46c2-9eed-7632900c46a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2333e7-b337-478e-8692-fc568aafdbe2', 'volume_name': 'volume-1c2333e7-b337-478e-8692-fc568aafdbe2', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17310fd5-c8be-4e02-b423-bcbe80fc5422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17310fd5-c8be-4e02-b423-bcbe80fc5422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf096614-9ca1-4269-8958-8d3f97878d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:07 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Volume 1c2333e7-b337-478e-8692-fc568aafdbe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2333e7-b337-478e-8692-fc568aafdbe2', 'volume_size': 1} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-298644541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2333e7-b337-478e-8692-fc568aafdbe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cfdc1023649aa89846032daaffbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:07Z,use_quota=True,user_id='2eb835ee02ab4e95a0f375119693d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Creating volume 1c2333e7-b337-478e-8692-fc568aafdbe2 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:07 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5436762b-79a3-40f0-bc2a-a65db36dee53 tempest-ProjectReaderTests-390922480 None] Lock "cinder-3ffdabb8-fa8d-4acf-9425-b7c76ea27510-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:07 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2 1073741824 Sep 05 04:59:07 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:07 devstack sudo[109704]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.279s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:07 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Deleted volume successfully. Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-935e4250-de50-44c1-a49e-54a0cf20b557 tempest-CreateVolumesFromSnapshotTest-832519806 None] Lock "cinder-420e8906-5991-416a-b57a-6bb831548e22-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:07 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2 1073741824" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:07 devstack sudo[109714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2 Sep 05 04:59:07 devstack sudo[109714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:07 devstack sudo[109714]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2" returned: 0 in 0.308s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.061s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf096614-9ca1-4269-8958-8d3f97878d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2333e7-b337-478e-8692-fc568aafdbe2', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e3255c-5bba-4294-83e6-99ed96ff1d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Creating offline snapshot 4034846b-9023-49ba-aab6-063d2e095ac8 of volume dafa47d3-0c61-4edb-97aa-5aafc4f862a9 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:59:07 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Volume volume-1c2333e7-b337-478e-8692-fc568aafdbe2 (1c2333e7-b337-478e-8692-fc568aafdbe2): created successfully Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e3255c-5bba-4294-83e6-99ed96ff1d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Flow 'volume_create_manager' (abab3d1b-7ca3-481b-bc52-a06ebca2262d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[941af1e3-c60c-4d3e-a512-f5592ac06d73]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:07 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3b767523-170a-4f66-9e4a-6da415c2f935 tempest-ProjectReaderTests-2128575756 None] Created volume successfully. Sep 05 04:59:08 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 Sep 05 04:59:08 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Flow 'volume_create_manager' (fbdeae56-b5b8-4f5f-b48e-fcb40a1356fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fc70eb-ffb1-4480-9e37-2e8f9436b78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fc70eb-ffb1-4480-9e37-2e8f9436b78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-431590652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fd5a44-0675-4997-8d93-606303e45e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4873896f73a84ffc9f852ad1e2000a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:08Z,use_quota=True,user_id='3243fb5bb12d4bb7828ce16f18d4331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97be702-e476-4fee-b1c6-3759aad53b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97be702-e476-4fee-b1c6-3759aad53b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfb991e-d94b-4bae-8cbd-16cbcdba998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfb991e-d94b-4bae-8cbd-16cbcdba998c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fd5a44-0675-4997-8d93-606303e45e91', 'volume_name': 'volume-b0fd5a44-0675-4997-8d93-606303e45e91', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97dcb881-076c-4fd1-8638-80ca99532e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97dcb881-076c-4fd1-8638-80ca99532e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:08 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341ed8af-e12a-4965-9940-9f214e6a1391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:08 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Volume b0fd5a44-0675-4997-8d93-606303e45e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fd5a44-0675-4997-8d93-606303e45e91', 'volume_size': 1} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" returned: 0 in 0.403s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:08 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 1G Sep 05 04:59:08 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:08 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 1G" returned: 0 in 0.451s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:08 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 Sep 05 04:59:08 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:09 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Acquiring lock "cinder-1c2333e7-b337-478e-8692-fc568aafdbe2-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8" returned: 0 in 0.330s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:09 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 is being set with open permissions: ugo+rw Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Lock "cinder-1c2333e7-b337-478e-8692-fc568aafdbe2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:09 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 Sep 05 04:59:09 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Acquiring lock "cinder-quobyte-1c2333e7-b337-478e-8692-fc568aafdbe2" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Lock "cinder-quobyte-1c2333e7-b337-478e-8692-fc568aafdbe2" acquired by "delete_volume" :: waited 0.019s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe806f88-7633-41ce-91da-7c9e8c3bfd17]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:09 devstack sudo[109736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2 Sep 05 04:59:09 devstack sudo[109736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:09 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8" returned: 0 in 0.297s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:09 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.info Sep 05 04:59:09 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:09 devstack sudo[109736]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2" returned: 0 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:09 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2 Sep 05 04:59:09 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:09 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.info" returned: 0 in 0.266s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:09 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.info is being set with open permissions: ugo+rw Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:09 devstack sudo[109747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.info Sep 05 04:59:09 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:09 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1c2333e7-b337-478e-8692-fc568aafdbe2" returned: 0 in 0.274s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Lock "cinder-quobyte-1c2333e7-b337-478e-8692-fc568aafdbe2" released by "delete_volume" :: held 0.707s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:09 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Created reservations ['686df71f-c5f9-460f-9b45-d12393de7ac5', 'a2c87f98-3b9e-4ea0-88c2-b104fb804f30', '49d82607-fc50-42a7-93cd-1faf421abaa9', 'b92f9f6b-4fc7-4da6-a90a-e3b27c534726'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.info" returned: 0 in 0.302s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.704s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-431590652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fd5a44-0675-4997-8d93-606303e45e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4873896f73a84ffc9f852ad1e2000a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:08Z,use_quota=True,user_id='3243fb5bb12d4bb7828ce16f18d4331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Creating volume b0fd5a44-0675-4997-8d93-606303e45e91 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:10 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:10 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 1073741824 Sep 05 04:59:10 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:10 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a0b600d9-81a7-4134-88d6-7d5880e22c04 tempest-ProjectMemberTests-181407164 None] Create snapshot completed successfully Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:10 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:10 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:10 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.419s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:10 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Deleted volume successfully. Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc17095a-fa2d-495d-9567-188cc46e7a9b tempest-ProjectReaderTests-2128575756 None] Lock "cinder-1c2333e7-b337-478e-8692-fc568aafdbe2-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:10 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 1073741824" returned: 0 in 0.587s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:10 devstack sudo[109796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 Sep 05 04:59:10 devstack sudo[109796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:10 devstack sudo[109798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:10 devstack sudo[109798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:10 devstack sudo[109796]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91" returned: 0 in 0.318s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341ed8af-e12a-4965-9940-9f214e6a1391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fd5a44-0675-4997-8d93-606303e45e91', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:10 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60c165d-7688-41db-9010-2d88e502c8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-4034846b-9023-49ba-aab6-063d2e095ac8-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:11 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Volume volume-b0fd5a44-0675-4997-8d93-606303e45e91 (b0fd5a44-0675-4997-8d93-606303e45e91): created successfully Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60c165d-7688-41db-9010-2d88e502c8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Flow 'volume_create_manager' (fbdeae56-b5b8-4f5f-b48e-fcb40a1356fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Lock "cinder-4034846b-9023-49ba-aab6-063d2e095ac8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-4034846b-9023-49ba-aab6-063d2e095ac8" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:11 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9ada3036-002b-43d2-9e3a-a88ea00fa673 tempest-ProjectReaderTests-390922480 None] Created volume successfully. Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Flow 'volume_create_manager' (c76eb573-5a58-4ac2-9ba0-6ffccf9d550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:11 devstack sudo[109798]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f2006b-2d87-49e0-8e63-8735ec2dd35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.387s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f2006b-2d87-49e0-8e63-8735ec2dd35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033512377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50da6bcc-54ee-4028-85a5-ef2eca62739f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cfdc1023649aa89846032daaffbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:11Z,use_quota=True,user_id='2eb835ee02ab4e95a0f375119693d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24eac221-26ac-4e4d-89be-ac5264f90cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24eac221-26ac-4e4d-89be-ac5264f90cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527dec78-6433-44ee-a7ec-5cc8e32d4d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527dec78-6433-44ee-a7ec-5cc8e32d4d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50da6bcc-54ee-4028-85a5-ef2eca62739f', 'volume_name': 'volume-50da6bcc-54ee-4028-85a5-ef2eca62739f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67f1d04-9a0b-4f91-a354-d23e8ce2892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67f1d04-9a0b-4f91-a354-d23e8ce2892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1913c6-7a98-48b5-8aa7-97e384f02c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:11 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Volume 50da6bcc-54ee-4028-85a5-ef2eca62739f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50da6bcc-54ee-4028-85a5-ef2eca62739f', 'volume_size': 1} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033512377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50da6bcc-54ee-4028-85a5-ef2eca62739f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cfdc1023649aa89846032daaffbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:11Z,use_quota=True,user_id='2eb835ee02ab4e95a0f375119693d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Creating volume 50da6bcc-54ee-4028-85a5-ef2eca62739f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:11 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-4034846b-9023-49ba-aab6-063d2e095ac8" acquired by "_delete_snapshot" :: waited 0.140s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Deleting offline snapshot 4034846b-9023-49ba-aab6-063d2e095ac8 of volume dafa47d3-0c61-4edb-97aa-5aafc4f862a9 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:11 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f 1073741824 Sep 05 04:59:11 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] snapshot_file for this snap is: volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[581d3875-1e57-475e-a9a7-b3eb654404d0]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:11 devstack sudo[109804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 Sep 05 04:59:11 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:11 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8" returned: 0 in 0.447s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2008ff6-b0e7-4f25-99f2-722c4d642c5b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:11 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f 1073741824" returned: 0 in 0.578s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:11 devstack sudo[109815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f Sep 05 04:59:11 devstack sudo[109815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:11 devstack sudo[109814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 Sep 05 04:59:11 devstack sudo[109814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:12 devstack sudo[109815]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f" returned: 0 in 0.273s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.547s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1913c6-7a98-48b5-8aa7-97e384f02c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50da6bcc-54ee-4028-85a5-ef2eca62739f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d27e05f-957b-4477-9952-91a6c4ab5f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Creating offline snapshot d623bcd7-a8f2-453a-a3f6-05aec32a80e7 of volume b0fd5a44-0675-4997-8d93-606303e45e91 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:59:12 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Volume volume-50da6bcc-54ee-4028-85a5-ef2eca62739f (50da6bcc-54ee-4028-85a5-ef2eca62739f): created successfully Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d27e05f-957b-4477-9952-91a6c4ab5f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Flow 'volume_create_manager' (c76eb573-5a58-4ac2-9ba0-6ffccf9d550e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50dc963-4436-489b-a454-13f88a11ced9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:12 devstack sudo[109814]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" returned: 0 in 0.440s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:12 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8daea8d8-e2a1-45d5-993f-011b8079c661 tempest-ProjectReaderTests-2128575756 None] Created volume successfully. Sep 05 04:59:12 devstack sudo[109823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 Sep 05 04:59:12 devstack sudo[109823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:12 devstack sudo[109822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 Sep 05 04:59:12 devstack sudo[109822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:12 devstack sudo[109822]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:12 devstack sudo[109823]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91" returned: 0 in 0.372s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8" returned: 0 in 0.367s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:12 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 1G Sep 05 04:59:12 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:12 devstack sudo[109833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8 Sep 05 04:59:12 devstack sudo[109833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:12 devstack sudo[109833]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9.4034846b-9023-49ba-aab6-063d2e095ac8" returned: 0 in 0.247s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-4034846b-9023-49ba-aab6-063d2e095ac8" released by "_delete_snapshot" :: held 1.623s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" released by "delete_snapshot" :: held 1.773s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:12 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Created reservations ['b5077283-6675-4ec0-8b5b-7483ea0f57ac', '97644953-c560-43e5-94c6-5625a3ba7363', '9002b33f-a199-4da4-a8a7-93f7e3574022', '8ff6e0d7-2297-44a0-b9e6-0493227df589'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:13 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Delete snapshot completed successfully. Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d69ce577-d8c5-4afc-a1db-eda947b16ead tempest-ProjectMemberTests-181407164 None] Lock "cinder-4034846b-9023-49ba-aab6-063d2e095ac8-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:13 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Acquiring lock "cinder-50da6bcc-54ee-4028-85a5-ef2eca62739f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 1G" returned: 0 in 0.490s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fd5a44-0675-4997-8d93-606303e45e91 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Lock "cinder-50da6bcc-54ee-4028-85a5-ef2eca62739f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:13 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fd5a44-0675-4997-8d93-606303e45e91 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 Sep 05 04:59:13 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Acquiring lock "cinder-quobyte-50da6bcc-54ee-4028-85a5-ef2eca62739f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Lock "cinder-quobyte-50da6bcc-54ee-4028-85a5-ef2eca62739f" acquired by "delete_volume" :: waited 0.032s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e4153a-f7d1-4011-90c0-3d47b4922099]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-dafa47d3-0c61-4edb-97aa-5aafc4f862a9-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Lock "cinder-dafa47d3-0c61-4edb-97aa-5aafc4f862a9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:13 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f Sep 05 04:59:13 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c80261-4a6f-4ece-9cf6-cabe28dc21e9]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:13 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fd5a44-0675-4997-8d93-606303e45e91 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7" returned: 0 in 0.408s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:13 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 is being set with open permissions: ugo+rw Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:13 devstack sudo[109851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 Sep 05 04:59:13 devstack sudo[109851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:13 devstack sudo[109850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 Sep 05 04:59:13 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:13 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f" returned: 0 in 0.548s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:13 devstack sudo[109851]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:13 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f Sep 05 04:59:13 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7" returned: 0 in 0.317s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:13 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" returned: 0 in 0.446s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:13 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:13 devstack sudo[109863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.info Sep 05 04:59:13 devstack sudo[109863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:13 devstack sudo[109864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9 Sep 05 04:59:13 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:14 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-50da6bcc-54ee-4028-85a5-ef2eca62739f" returned: 0 in 0.289s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Lock "cinder-quobyte-50da6bcc-54ee-4028-85a5-ef2eca62739f" released by "delete_volume" :: held 0.902s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:14 devstack sudo[109863]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.info" returned: 0 in 0.348s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:14 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.info is being set with open permissions: ugo+rw Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Created reservations ['2bd35f01-0410-49fe-8765-a25aafd1b93f', '29fc5ad2-6dd1-4f02-8194-26bbd71316c1', '006b32df-e14a-4338-ad11-1f281e976f50', '9729d87f-9125-4cc5-9ec5-e81858b5fbd8'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:14 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" returned: 0 in 0.381s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:14 devstack sudo[109870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.info Sep 05 04:59:14 devstack sudo[109870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-dafa47d3-0c61-4edb-97aa-5aafc4f862a9" released by "delete_volume" :: held 0.917s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Created reservations ['8bac926d-2e57-4f2f-a116-9ec38af145e3', '2ce56088-5d53-4c64-872c-ade6a0b9fbec', 'b6f212b5-0ef0-4127-893e-565d886e3f89', '1c52ab0a-23af-4ebc-ab1f-49bfb76b833e'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:14 devstack sudo[109872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:14 devstack sudo[109872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:14 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:14 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:14 devstack sudo[109870]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.info" returned: 0 in 0.348s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:14 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a268ab41-158f-4cf2-be2d-3ab30815e0bb tempest-ProjectReaderTests-390922480 None] Create snapshot completed successfully Sep 05 04:59:14 devstack sudo[109872]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.287s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:14 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Deleted volume successfully. Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-f58e64e4-7748-43a8-8e13-5a05222ebeee tempest-ProjectReaderTests-2128575756 None] Lock "cinder-50da6bcc-54ee-4028-85a5-ef2eca62739f-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-d623bcd7-a8f2-453a-a3f6-05aec32a80e7-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:14 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.270s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:14 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Deleted volume successfully. Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Lock "cinder-d623bcd7-a8f2-453a-a3f6-05aec32a80e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-b0fd5a44-0675-4997-8d93-606303e45e91" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-92c2f747-807e-4264-8e0d-2226d19761cb tempest-ProjectMemberTests-181407164 None] Lock "cinder-dafa47d3-0c61-4edb-97aa-5aafc4f862a9-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-b0fd5a44-0675-4997-8d93-606303e45e91" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-d623bcd7-a8f2-453a-a3f6-05aec32a80e7" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-d623bcd7-a8f2-453a-a3f6-05aec32a80e7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Deleting offline snapshot d623bcd7-a8f2-453a-a3f6-05aec32a80e7 of volume b0fd5a44-0675-4997-8d93-606303e45e91 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] snapshot_file for this snap is: volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[79657e67-84a9-45b4-89ff-6f10be8e0df8]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:14 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:14 devstack sudo[109880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 Sep 05 04:59:14 devstack sudo[109880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:15 devstack sudo[109880]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7" returned: 0 in 0.356s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:15 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fd5a44-0675-4997-8d93-606303e45e91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:15 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5877ac36-125d-4b20-aa52-d3e7e18d76c8]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:15 devstack sudo[109885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 Sep 05 04:59:15 devstack sudo[109885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:15 devstack sudo[109885]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91" returned: 0 in 0.439s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:15 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:15 devstack sudo[109891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 Sep 05 04:59:15 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (d208ee93-212c-451d-a0f6-13c775e40830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c67c33-7a28-49f2-a5a3-9ccf921e811f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:16 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c67c33-7a28-49f2-a5a3-9ccf921e811f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-669417357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e207ff82-8039-464e-915a-64df011900da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:16Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c15166-2617-43f5-b018-dc43d34bc3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c15166-2617-43f5-b018-dc43d34bc3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b24802-a8fc-415c-aab5-4b7ffa0b5805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b24802-a8fc-415c-aab5-4b7ffa0b5805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e207ff82-8039-464e-915a-64df011900da', 'volume_name': 'volume-e207ff82-8039-464e-915a-64df011900da', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1971171b-a794-48a0-9754-10d1aea33963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1971171b-a794-48a0-9754-10d1aea33963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1571493e-e61e-431e-90a7-6d76c68bb639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:16 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Volume e207ff82-8039-464e-915a-64df011900da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e207ff82-8039-464e-915a-64df011900da', 'volume_size': 1} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-669417357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e207ff82-8039-464e-915a-64df011900da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:16Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Creating volume e207ff82-8039-464e-915a-64df011900da {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:16 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7" returned: 0 in 0.575s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:16 devstack sudo[109896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da 1073741824 Sep 05 04:59:16 devstack sudo[109896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:16 devstack sudo[109897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7 Sep 05 04:59:16 devstack sudo[109897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:16 devstack sudo[109897]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91.d623bcd7-a8f2-453a-a3f6-05aec32a80e7" returned: 0 in 0.314s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-d623bcd7-a8f2-453a-a3f6-05aec32a80e7" released by "_delete_snapshot" :: held 1.791s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-b0fd5a44-0675-4997-8d93-606303e45e91" released by "delete_snapshot" :: held 1.820s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Created reservations ['9aba1bfd-c201-4fd2-967f-df4a06268ed5', 'ea424a2d-ffcf-41a7-9328-595375424c51', '34f95c59-a577-4523-87fc-63c61edb0b7d', 'a24901f5-d80d-4a1e-aed2-28136a82e959'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:16 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Delete snapshot completed successfully. Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-2529118b-2895-47bf-be00-d6fc9d4f7c2b tempest-ProjectReaderTests-390922480 None] Lock "cinder-d623bcd7-a8f2-453a-a3f6-05aec32a80e7-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:16 devstack sudo[109896]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da 1073741824" returned: 0 in 0.607s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:16 devstack sudo[109905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da Sep 05 04:59:16 devstack sudo[109905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:16 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-b0fd5a44-0675-4997-8d93-606303e45e91-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Lock "cinder-b0fd5a44-0675-4997-8d93-606303e45e91-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-b0fd5a44-0675-4997-8d93-606303e45e91" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-b0fd5a44-0675-4997-8d93-606303e45e91" acquired by "delete_volume" :: waited 0.025s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9177c3-e62b-4b43-ae11-9d7e91bf04ab]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:17 devstack sudo[109905]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1571493e-e61e-431e-90a7-6d76c68bb639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e207ff82-8039-464e-915a-64df011900da', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe83f33-1eb5-42f2-92dc-28f50aa01b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:17 devstack sudo[109907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 Sep 05 04:59:17 devstack sudo[109907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:17 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Volume volume-e207ff82-8039-464e-915a-64df011900da (e207ff82-8039-464e-915a-64df011900da): created successfully Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe83f33-1eb5-42f2-92dc-28f50aa01b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (d208ee93-212c-451d-a0f6-13c775e40830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:17 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b22d7be0-a2c8-4dd0-981f-cce03daee2cc tempest-ProjectMemberTests-181407164 None] Created volume successfully. Sep 05 04:59:17 devstack sudo[109907]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91" returned: 0 in 0.429s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:17 devstack sudo[109913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91 Sep 05 04:59:17 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:17 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b0fd5a44-0675-4997-8d93-606303e45e91" returned: 0 in 0.284s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-b0fd5a44-0675-4997-8d93-606303e45e91" released by "delete_volume" :: held 0.783s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:17 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Created reservations ['a80754e7-e5f1-41cc-894e-96cf1676f42b', 'c6419d63-c807-44e3-8f9e-138ede0e2dbb', '6ed4b705-b10c-4a19-aa14-c0409dd3c75d', 'aae376b8-846f-4653-9084-d97464f1d5e1'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:18 devstack sudo[109916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:18 devstack sudo[109916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:18 devstack sudo[109916]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.264s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:18 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Deleted volume successfully. Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-c1f2b4f6-8675-4e95-b4bc-508d12c3572b tempest-ProjectReaderTests-390922480 None] Lock "cinder-b0fd5a44-0675-4997-8d93-606303e45e91-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Creating offline snapshot 7a60062c-62aa-48a5-8dcc-061fc1f8f68e of volume e207ff82-8039-464e-915a-64df011900da {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a711f4e-7941-42c8-b3d3-a6fa051c20c4]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:18 devstack sudo[109919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da Sep 05 04:59:18 devstack sudo[109919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Flow 'volume_create_manager' (90784ef0-d2ac-4789-b266-d98b53325779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de533715-fd12-4e64-9bb9-04e6c90e5e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de533715-fd12-4e64-9bb9-04e6c90e5e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485533314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c6f6c8-76c5-49bd-9558-ee844d0d0ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4873896f73a84ffc9f852ad1e2000a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:19Z,use_quota=True,user_id='3243fb5bb12d4bb7828ce16f18d4331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f314bc48-bba0-4af4-a29d-4e835ac6163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f314bc48-bba0-4af4-a29d-4e835ac6163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b07a9d-b671-4591-96c1-9957c1f00bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b07a9d-b671-4591-96c1-9957c1f00bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c6f6c8-76c5-49bd-9558-ee844d0d0ca7', 'volume_name': 'volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2830897-5f4d-49b7-88da-8f077d8342d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2830897-5f4d-49b7-88da-8f077d8342d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accf8382-9e28-4dd2-ba31-057544a6d5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:18 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Volume 32c6f6c8-76c5-49bd-9558-ee844d0d0ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7', 'volume_size': 1} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:18 devstack sudo[109919]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da" returned: 0 in 0.413s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:18 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:18 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e 1G Sep 05 04:59:18 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:19 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e 1G" returned: 0 in 0.424s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e207ff82-8039-464e-915a-64df011900da -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:19 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e207ff82-8039-464e-915a-64df011900da -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e Sep 05 04:59:19 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:19 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e207ff82-8039-464e-915a-64df011900da -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e" returned: 0 in 0.304s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:19 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e is being set with open permissions: ugo+rw Sep 05 04:59:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:19 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e Sep 05 04:59:19 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:19 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e" returned: 0 in 0.261s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:19 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:19 devstack sudo[109944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.info Sep 05 04:59:19 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:20 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.info" returned: 0 in 0.254s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:20 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.info is being set with open permissions: ugo+rw Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:20 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.info Sep 05 04:59:20 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:20 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.info" returned: 0 in 0.264s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485533314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c6f6c8-76c5-49bd-9558-ee844d0d0ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4873896f73a84ffc9f852ad1e2000a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:19Z,use_quota=True,user_id='3243fb5bb12d4bb7828ce16f18d4331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Creating volume 32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:20 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:20 devstack sudo[109950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 1073741824 Sep 05 04:59:20 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:20 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4c76cd8e-350d-40ab-8b69-46cb3d638869 tempest-ProjectMemberTests-181407164 None] Create snapshot completed successfully Sep 05 04:59:20 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 1073741824" returned: 0 in 0.457s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:20 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:21 devstack sudo[109956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 Sep 05 04:59:21 devstack sudo[109956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:21 devstack sudo[109956]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" returned: 0 in 0.244s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accf8382-9e28-4dd2-ba31-057544a6d5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e72002-d060-4bbe-819a-f1fbe2a7425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:21 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Volume volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 (32c6f6c8-76c5-49bd-9558-ee844d0d0ca7): created successfully Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e72002-d060-4bbe-819a-f1fbe2a7425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Flow 'volume_create_manager' (90784ef0-d2ac-4789-b266-d98b53325779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:21 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-cf9d776d-034c-4e2c-9bd1-22196bef5cbf tempest-ProjectReaderTests-390922480 None] Created volume successfully. Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-7a60062c-62aa-48a5-8dcc-061fc1f8f68e-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Lock "cinder-7a60062c-62aa-48a5-8dcc-061fc1f8f68e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-e207ff82-8039-464e-915a-64df011900da" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-e207ff82-8039-464e-915a-64df011900da" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-7a60062c-62aa-48a5-8dcc-061fc1f8f68e" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-7a60062c-62aa-48a5-8dcc-061fc1f8f68e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Deleting offline snapshot 7a60062c-62aa-48a5-8dcc-061fc1f8f68e of volume e207ff82-8039-464e-915a-64df011900da {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] snapshot_file for this snap is: volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9dca8c-f1cd-43bb-837f-c7f02cb5ee26]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:21 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:21 devstack sudo[109959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e Sep 05 04:59:21 devstack sudo[109959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Creating offline snapshot d26169de-40c9-4c46-9980-e95b917716cb of volume 32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd580824-5536-4dfe-a43b-088016baa4dc]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:22 devstack sudo[109959]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e" returned: 0 in 0.442s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e207ff82-8039-464e-915a-64df011900da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[7576a5fc-1073-46f8-8ae9-a4a19a44f9cb]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:22 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 Sep 05 04:59:22 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:22 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da Sep 05 04:59:22 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:22 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" returned: 0 in 0.420s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:22 devstack sudo[109973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb 1G Sep 05 04:59:22 devstack sudo[109973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:22 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da" returned: 0 in 0.416s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:22 devstack sudo[109977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e Sep 05 04:59:22 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:22 devstack sudo[109973]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb 1G" returned: 0 in 0.456s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:22 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:23 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e" returned: 0 in 0.401s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:23 devstack sudo[109986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb Sep 05 04:59:23 devstack sudo[109986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:23 devstack sudo[109988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e Sep 05 04:59:23 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:23 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da.7a60062c-62aa-48a5-8dcc-061fc1f8f68e" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:23 devstack sudo[109986]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb" returned: 0 in 0.307s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:23 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb is being set with open permissions: ugo+rw Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-7a60062c-62aa-48a5-8dcc-061fc1f8f68e" released by "_delete_snapshot" :: held 1.625s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-e207ff82-8039-464e-915a-64df011900da" released by "delete_snapshot" :: held 1.649s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:23 devstack sudo[109994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb Sep 05 04:59:23 devstack sudo[109994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Created reservations ['03a561c2-e1c9-4b62-9920-376e3382d342', 'fda36f2b-1201-4d5e-b8e9-46a57cb0c11f', 'f0e1d148-632e-4612-b6a9-0abd8d211166', '76fedaaa-f60c-46e2-b3da-0e3c20885707'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:23 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Delete snapshot completed successfully. Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5bfc59b6-6661-43a4-8a94-97a1aa93ae23 tempest-ProjectMemberTests-181407164 None] Lock "cinder-7a60062c-62aa-48a5-8dcc-061fc1f8f68e-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:23 devstack sudo[109994]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb" returned: 0 in 0.247s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:23 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.info Sep 05 04:59:23 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-e207ff82-8039-464e-915a-64df011900da-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Lock "cinder-e207ff82-8039-464e-915a-64df011900da-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:23 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.info" returned: 0 in 0.270s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:23 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.info is being set with open permissions: ugo+rw Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:23 devstack sudo[110000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.info Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-e207ff82-8039-464e-915a-64df011900da" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:23 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-e207ff82-8039-464e-915a-64df011900da" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[29302124-e734-49c8-8d2d-8c799846f982]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:23 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:24 devstack sudo[110002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da Sep 05 04:59:24 devstack sudo[110002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:24 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.info" returned: 0 in 0.264s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:24 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-c025ef73-ce20-4d96-bdb3-e3b678e47506 tempest-ProjectReaderTests-390922480 None] Create snapshot completed successfully Sep 05 04:59:24 devstack sudo[110002]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da" returned: 0 in 0.370s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:24 devstack sudo[110008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da Sep 05 04:59:24 devstack sudo[110008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:24 devstack sudo[110008]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-e207ff82-8039-464e-915a-64df011900da" returned: 0 in 0.239s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-e207ff82-8039-464e-915a-64df011900da" released by "delete_volume" :: held 0.666s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Created reservations ['4a3b9b27-fe67-4742-bdbc-5f05a807c2b4', 'f3338c83-6141-4192-89ff-46b3a4c94783', '5d7b526a-044f-4ba1-bd62-99f68bdfbdd5', '1aa92c30-13c2-46f6-8cfb-6635e8d9b97e'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:24 devstack sudo[110012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:24 devstack sudo[110012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:24 devstack sudo[110012]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.276s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:24 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Deleted volume successfully. Sep 05 04:59:24 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-5becceaa-628f-43f5-9892-4c1c541c32a8 tempest-ProjectMemberTests-181407164 None] Lock "cinder-e207ff82-8039-464e-915a-64df011900da-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-d26169de-40c9-4c46-9980-e95b917716cb-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Lock "cinder-d26169de-40c9-4c46-9980-e95b917716cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-d26169de-40c9-4c46-9980-e95b917716cb" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-d26169de-40c9-4c46-9980-e95b917716cb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Deleting offline snapshot d26169de-40c9-4c46-9980-e95b917716cb of volume 32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] snapshot_file for this snap is: volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd93d25-71ce-4965-9a59-9f1c7a217b55]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:25 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb Sep 05 04:59:25 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (b6258334-ed76-4de8-a10a-24981145307b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68a00be-9579-43f9-ad32-345d377f0718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68a00be-9579-43f9-ad32-345d377f0718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-931824539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6b8c60-907b-4837-bb46-33ab9a399533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:25Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef1506c-fad0-45df-8743-24b94203e8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef1506c-fad0-45df-8743-24b94203e8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401547b6-e6bd-4b75-8da1-96b3e597b9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401547b6-e6bd-4b75-8da1-96b3e597b9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6b8c60-907b-4837-bb46-33ab9a399533', 'volume_name': 'volume-1e6b8c60-907b-4837-bb46-33ab9a399533', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3c8090-404f-4818-8157-969c00a3f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3c8090-404f-4818-8157-969c00a3f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171907a1-537e-47a3-a20f-832abac6b8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:25 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Volume 1e6b8c60-907b-4837-bb46-33ab9a399533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6b8c60-907b-4837-bb46-33ab9a399533', 'volume_size': 1} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-931824539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6b8c60-907b-4837-bb46-33ab9a399533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:25Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Creating volume 1e6b8c60-907b-4837-bb46-33ab9a399533 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:25 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:25 devstack sudo[110018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 1073741824 Sep 05 04:59:25 devstack sudo[110018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:25 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb" returned: 0 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9059d77-5510-4d38-b2dd-afafa70af92d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:25 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:25 devstack sudo[110023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 Sep 05 04:59:25 devstack sudo[110023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:26 devstack sudo[110018]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 1073741824" returned: 0 in 0.460s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:26 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 Sep 05 04:59:26 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:26 devstack sudo[110023]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" returned: 0 in 0.406s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:26 devstack sudo[110034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb Sep 05 04:59:26 devstack sudo[110034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:26 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533" returned: 0 in 0.252s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171907a1-537e-47a3-a20f-832abac6b8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6b8c60-907b-4837-bb46-33ab9a399533', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536c1144-8c64-4514-8bb7-dc03514be08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:26 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Volume volume-1e6b8c60-907b-4837-bb46-33ab9a399533 (1e6b8c60-907b-4837-bb46-33ab9a399533): created successfully Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536c1144-8c64-4514-8bb7-dc03514be08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (b6258334-ed76-4de8-a10a-24981145307b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:26 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-66956ee4-fdef-4991-8867-d56b464ff0c3 tempest-ProjectMemberTests-181407164 None] Created volume successfully. Sep 05 04:59:26 devstack sudo[110034]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb" returned: 0 in 0.358s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:26 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb Sep 05 04:59:26 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Creating offline snapshot 973bd526-23b5-486b-85a9-8874a5450749 of volume 1e6b8c60-907b-4837-bb46-33ab9a399533 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[290dc248-3bdc-47b1-bcd5-cbff1fec4054]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:26 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7.d26169de-40c9-4c46-9980-e95b917716cb" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-d26169de-40c9-4c46-9980-e95b917716cb" released by "_delete_snapshot" :: held 1.493s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:26 devstack sudo[110043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" released by "delete_snapshot" :: held 1.524s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:26 devstack sudo[110043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Created reservations ['9c232167-21e4-4300-9cc8-c7ebb97e815b', '91ffbb93-bd73-4532-9505-16548d043829', '7b42e95a-172c-4717-bb38-7beb1c2a4ff2', 'ef190172-559e-4b4b-9618-b7da568f9eb8'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:26 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Delete snapshot completed successfully. Sep 05 04:59:26 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7b3251dd-e336-44af-b2d6-6d17a8bf3156 tempest-ProjectReaderTests-390922480 None] Lock "cinder-d26169de-40c9-4c46-9980-e95b917716cb-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:27 devstack sudo[110043]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533" returned: 0 in 0.371s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:27 devstack sudo[110049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 1G Sep 05 04:59:27 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Lock "cinder-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Acquiring lock "cinder-quobyte-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:27 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 1G" returned: 0 in 0.446s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e6b8c60-907b-4837-bb46-33ab9a399533 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e16479a-e03e-4513-ae2a-505de2f7dc99]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:27 devstack sudo[110056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e6b8c60-907b-4837-bb46-33ab9a399533 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 Sep 05 04:59:27 devstack sudo[110056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:27 devstack sudo[110057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 Sep 05 04:59:27 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:27 devstack sudo[110056]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e6b8c60-907b-4837-bb46-33ab9a399533 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749" returned: 0 in 0.295s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:27 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 is being set with open permissions: ugo+rw Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:27 devstack sudo[110063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 Sep 05 04:59:27 devstack sudo[110063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:27 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" returned: 0 in 0.376s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:27 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:27 devstack sudo[110068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7 Sep 05 04:59:27 devstack sudo[110068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:28 devstack sudo[110063]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:28 devstack sudo[110071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.info Sep 05 04:59:28 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:28 devstack sudo[110068]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" returned: 0 in 0.251s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Lock "cinder-quobyte-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7" released by "delete_volume" :: held 0.691s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Created reservations ['229fe6be-8baf-4ff8-aedd-1f3aeac0a1d2', 'f32cb039-a984-4369-a4a1-4db386ad35a3', '36ce18d6-1678-42eb-8d0f-6980ec23c6d3', '7067d054-dd11-4cad-b416-180a1df0414c'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:28 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:28 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:28 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.info" returned: 0 in 0.265s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:28 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.info is being set with open permissions: ugo+rw Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:28 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.info Sep 05 04:59:28 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:28 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.259s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:28 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Deleted volume successfully. Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1963d958-1968-4c26-b103-264623711c94 tempest-ProjectReaderTests-390922480 None] Lock "cinder-32c6f6c8-76c5-49bd-9558-ee844d0d0ca7-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:28 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.info" returned: 0 in 0.259s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:28 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4661406d-6666-4360-aef9-a6fff1e20aa9 tempest-ProjectMemberTests-181407164 None] Create snapshot completed successfully Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-973bd526-23b5-486b-85a9-8874a5450749-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Lock "cinder-973bd526-23b5-486b-85a9-8874a5450749-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-1e6b8c60-907b-4837-bb46-33ab9a399533" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-1e6b8c60-907b-4837-bb46-33ab9a399533" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-973bd526-23b5-486b-85a9-8874a5450749" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-973bd526-23b5-486b-85a9-8874a5450749" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Deleting offline snapshot 973bd526-23b5-486b-85a9-8874a5450749 of volume 1e6b8c60-907b-4837-bb46-33ab9a399533 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] snapshot_file for this snap is: volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[74498d68-499b-4f13-b567-c5fea1d9fbee]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:28 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:29 devstack sudo[110081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 Sep 05 04:59:29 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:29 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749" returned: 0 in 0.371s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:29 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e6b8c60-907b-4837-bb46-33ab9a399533(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:29 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[1487954c-c431-42ed-9215-61abd525f39d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:29 devstack sudo[110086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 Sep 05 04:59:29 devstack sudo[110086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:29 devstack sudo[110086]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533" returned: 0 in 0.385s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:29 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:29 devstack sudo[110091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 Sep 05 04:59:29 devstack sudo[110091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:30 devstack sudo[110091]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749" returned: 0 in 0.380s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:30 devstack sudo[110097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749 Sep 05 04:59:30 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:30 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533.973bd526-23b5-486b-85a9-8874a5450749" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-973bd526-23b5-486b-85a9-8874a5450749" released by "_delete_snapshot" :: held 1.499s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-1e6b8c60-907b-4837-bb46-33ab9a399533" released by "delete_snapshot" :: held 1.523s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:30 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Created reservations ['2a1b3c1e-82f5-498f-becf-4307390e82cc', '3d37e1df-f054-47f5-a0d1-8ec3be8eee60', '6e7d11d1-e21e-4664-9f8d-8d4ed95e77f2', 'af3615dd-45c0-4fac-a7e7-38c72938b6a1'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Delete snapshot completed successfully. Sep 05 04:59:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-0644fd73-c009-4e9d-8253-daccd4e5fb36 tempest-ProjectMemberTests-181407164 None] Lock "cinder-973bd526-23b5-486b-85a9-8874a5450749-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-1e6b8c60-907b-4837-bb46-33ab9a399533-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:30 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Lock "cinder-1e6b8c60-907b-4837-bb46-33ab9a399533-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-1e6b8c60-907b-4837-bb46-33ab9a399533" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-1e6b8c60-907b-4837-bb46-33ab9a399533" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb101049-7f3c-496f-b1a2-98d76e108709]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:31 devstack sudo[110100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 Sep 05 04:59:31 devstack sudo[110100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:31 devstack sudo[110100]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533" returned: 0 in 0.388s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:31 devstack sudo[110105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533 Sep 05 04:59:31 devstack sudo[110105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:31 devstack sudo[110105]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-1e6b8c60-907b-4837-bb46-33ab9a399533" returned: 0 in 0.248s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-1e6b8c60-907b-4837-bb46-33ab9a399533" released by "delete_volume" :: held 0.699s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Created reservations ['c429fa63-5de6-40d8-aa88-73e772b57742', 'acc07937-cf68-479d-8f0a-1ed8c8bff377', 'c21d2e2c-f75b-40e2-b813-94538de60d77', 'c3017842-a04d-4de0-af22-88780a4644bb'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:31 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:31 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:32 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.281s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Deleted volume successfully. Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-60e9f343-d9cd-4134-a204-064438c8c4b0 tempest-ProjectMemberTests-181407164 None] Lock "cinder-1e6b8c60-907b-4837-bb46-33ab9a399533-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (9c80e689-bbda-43f3-85e2-3ae017307970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece69eb4-74b3-4d21-83fb-b21657d5798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece69eb4-74b3-4d21-83fb-b21657d5798b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-980382980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28307a46-ebb0-42a7-9087-e4fbb66e1cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:33Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf42e38-9b3b-4f23-b264-c785bb06fb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf42e38-9b3b-4f23-b264-c785bb06fb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae453450-b236-4678-bc1a-17e28be86128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae453450-b236-4678-bc1a-17e28be86128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28307a46-ebb0-42a7-9087-e4fbb66e1cf6', 'volume_name': 'volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578a5d5d-d11f-403b-97cc-2731edd54690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578a5d5d-d11f-403b-97cc-2731edd54690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b812d0f-22fe-405b-8dd1-48fd58efe8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:32 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Volume 28307a46-ebb0-42a7-9087-e4fbb66e1cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6', 'volume_size': 1} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-980382980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28307a46-ebb0-42a7-9087-e4fbb66e1cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:33Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Creating volume 28307a46-ebb0-42a7-9087-e4fbb66e1cf6 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:32 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:32 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 1073741824 Sep 05 04:59:32 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:33 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 1073741824" returned: 0 in 0.437s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:33 devstack sudo[110117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 Sep 05 04:59:33 devstack sudo[110117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:33 devstack sudo[110117]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" returned: 0 in 0.264s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b812d0f-22fe-405b-8dd1-48fd58efe8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da2f5b0-2fd2-44bc-9390-f9ea9c18cede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:33 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Volume volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 (28307a46-ebb0-42a7-9087-e4fbb66e1cf6): created successfully Sep 05 04:59:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da2f5b0-2fd2-44bc-9390-f9ea9c18cede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (9c80e689-bbda-43f3-85e2-3ae017307970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:33 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-5e23f9b1-8161-44b2-9570-4c848093ac9d tempest-ProjectMemberTests-181407164 None] Created volume successfully. Sep 05 04:59:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Creating offline snapshot 0334a498-bfb2-475b-ab69-9c835b16bfc8 of volume 28307a46-ebb0-42a7-9087-e4fbb66e1cf6 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:59:34 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b241c9f-f0e3-4d44-b764-2b7dc96a9b76]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:35 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 Sep 05 04:59:35 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:35 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" returned: 0 in 0.364s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:35 devstack sudo[110126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 1G Sep 05 04:59:35 devstack sudo[110126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:35 devstack sudo[110126]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 1G" returned: 0 in 0.498s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:35 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:35 devstack sudo[110132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 Sep 05 04:59:35 devstack sudo[110132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:36 devstack sudo[110132]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8" returned: 0 in 0.295s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:36 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 is being set with open permissions: ugo+rw Sep 05 04:59:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:36 devstack sudo[110137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 Sep 05 04:59:36 devstack sudo[110137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:36 devstack sudo[110137]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8" returned: 0 in 0.273s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:36 devstack sudo[110140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.info Sep 05 04:59:36 devstack sudo[110140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:36 devstack sudo[110140]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.info" returned: 0 in 0.262s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:36 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.info is being set with open permissions: ugo+rw Sep 05 04:59:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:36 devstack sudo[110143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.info Sep 05 04:59:36 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:36 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.info" returned: 0 in 0.264s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:36 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:36 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d8385701-94f4-4eec-ae1c-6d7f11fbe0a5 tempest-ProjectMemberTests-181407164 None] Create snapshot completed successfully Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-0334a498-bfb2-475b-ab69-9c835b16bfc8-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Lock "cinder-0334a498-bfb2-475b-ab69-9c835b16bfc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-0334a498-bfb2-475b-ab69-9c835b16bfc8" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-0334a498-bfb2-475b-ab69-9c835b16bfc8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Deleting offline snapshot 0334a498-bfb2-475b-ab69-9c835b16bfc8 of volume 28307a46-ebb0-42a7-9087-e4fbb66e1cf6 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] snapshot_file for this snap is: volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[73071b36-6e7a-448a-a0dd-f67a4f03cb19]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:38 devstack sudo[110146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 Sep 05 04:59:38 devstack sudo[110146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:38 devstack sudo[110146]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0650b205-ee7e-4e5f-a95a-0c15586c3615]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:38 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:38 devstack sudo[110151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 Sep 05 04:59:38 devstack sudo[110151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:39 devstack sudo[110151]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" returned: 0 in 0.389s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:39 devstack sudo[110156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 Sep 05 04:59:39 devstack sudo[110156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:39 devstack sudo[110156]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8" returned: 0 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:39 devstack sudo[110162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8 Sep 05 04:59:39 devstack sudo[110162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:39 devstack sudo[110162]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:39 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6.0334a498-bfb2-475b-ab69-9c835b16bfc8" returned: 0 in 0.298s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-0334a498-bfb2-475b-ab69-9c835b16bfc8" released by "_delete_snapshot" :: held 1.590s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" released by "delete_snapshot" :: held 1.623s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:39 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Created reservations ['653b8782-7664-4281-aef4-3f2736382458', '9361ce51-db55-4559-a3f6-116121a3731b', '07b2ab35-3784-4554-8fd8-06920dd767bf', '46e0030c-8722-4915-ace2-353e7ea8edac'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:39 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Delete snapshot completed successfully. Sep 05 04:59:39 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-9b902f13-0800-4a88-bb41-061f8616aa74 tempest-ProjectMemberTests-181407164 None] Lock "cinder-0334a498-bfb2-475b-ab69-9c835b16bfc8-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-28307a46-ebb0-42a7-9087-e4fbb66e1cf6-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Lock "cinder-28307a46-ebb0-42a7-9087-e4fbb66e1cf6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:40 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:40 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f80474-d05b-42de-9f5b-079428a4944a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:40 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 Sep 05 04:59:40 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:40 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" returned: 0 in 0.413s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:40 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:40 devstack sudo[110170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6 Sep 05 04:59:40 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:41 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" returned: 0 in 0.276s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-28307a46-ebb0-42a7-9087-e4fbb66e1cf6" released by "delete_volume" :: held 0.759s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Created reservations ['8a4fd9cb-d876-4673-a751-7ef8d96aa3a4', '90dfff01-fd63-471a-9104-8f3bfc54dfe4', '8ec2e4fa-6986-4525-9ddb-11f583b4ec9f', '4e26badb-d1d0-4399-81cb-d9c08037c0b6'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:41 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:41 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:41 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.290s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:41 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Deleted volume successfully. Sep 05 04:59:41 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-bf3ac623-4b33-4cee-a7d4-3ddeabe12cd0 tempest-ProjectMemberTests-181407164 None] Lock "cinder-28307a46-ebb0-42a7-9087-e4fbb66e1cf6-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (213ce781-d18c-4718-8826-d3519a04a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3378d7-56b5-46f6-b436-4b5457ca52ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3378d7-56b5-46f6-b436-4b5457ca52ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-345973613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f43cf6-d8ce-4868-a52b-d0dc1e8c646f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:42Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be9df27-3878-40f2-8c26-90ea35d923eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be9df27-3878-40f2-8c26-90ea35d923eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fd4037-053c-4ef7-879a-2a3357dca679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fd4037-053c-4ef7-879a-2a3357dca679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f43cf6-d8ce-4868-a52b-d0dc1e8c646f', 'volume_name': 'volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6913645-ee15-4522-897b-a836d2205d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6913645-ee15-4522-897b-a836d2205d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea5b82f-1ae8-4a93-bbaa-e1ad7826d67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Volume 33f43cf6-d8ce-4868-a52b-d0dc1e8c646f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f', 'volume_size': 1} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-345973613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f43cf6-d8ce-4868-a52b-d0dc1e8c646f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:42Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Creating volume 33f43cf6-d8ce-4868-a52b-d0dc1e8c646f {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:42 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:42 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f 1073741824 Sep 05 04:59:42 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:42 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f 1073741824" returned: 0 in 0.474s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:42 devstack sudo[110181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f Sep 05 04:59:42 devstack sudo[110181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:42 devstack sudo[110181]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" returned: 0 in 0.250s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea5b82f-1ae8-4a93-bbaa-e1ad7826d67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44fbee2-5018-41a1-9c73-db62ea2a3d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:42 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Volume volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f (33f43cf6-d8ce-4868-a52b-d0dc1e8c646f): created successfully Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44fbee2-5018-41a1-9c73-db62ea2a3d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:42 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (213ce781-d18c-4718-8826-d3519a04a640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:42 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-ea4d7109-80a7-47ff-9965-7f96b9c75d75 tempest-ProjectMemberTests-181407164 None] Created volume successfully. Sep 05 04:59:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:44 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Creating offline snapshot 73511bd2-ab56-4a2d-b7c7-e4cb1706f251 of volume 33f43cf6-d8ce-4868-a52b-d0dc1e8c646f {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:59:44 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[3369aa23-6228-4c3c-aa05-db9962f973fa]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:44 devstack sudo[110185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f Sep 05 04:59:44 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:44 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" returned: 0 in 0.391s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:44 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:44 devstack sudo[110191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 1G Sep 05 04:59:44 devstack sudo[110191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:45 devstack sudo[110191]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 1G" returned: 0 in 0.417s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:45 devstack sudo[110197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 Sep 05 04:59:45 devstack sudo[110197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:45 devstack sudo[110197]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251" returned: 0 in 0.402s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:45 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 is being set with open permissions: ugo+rw Sep 05 04:59:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:45 devstack sudo[110202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 Sep 05 04:59:45 devstack sudo[110202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:45 devstack sudo[110202]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251" returned: 0 in 0.272s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:45 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:45 devstack sudo[110205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.info Sep 05 04:59:45 devstack sudo[110205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:46 devstack sudo[110205]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.info" returned: 0 in 0.298s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:46 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.info is being set with open permissions: ugo+rw Sep 05 04:59:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:46 devstack sudo[110208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.info Sep 05 04:59:46 devstack sudo[110208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:46 devstack sudo[110208]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.info" returned: 0 in 0.315s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:46 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:46 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1cb58db4-aa46-4a7a-b267-ecc109e14dcb tempest-ProjectMemberTests-181407164 None] Create snapshot completed successfully Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-73511bd2-ab56-4a2d-b7c7-e4cb1706f251-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Lock "cinder-73511bd2-ab56-4a2d-b7c7-e4cb1706f251-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-73511bd2-ab56-4a2d-b7c7-e4cb1706f251" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-73511bd2-ab56-4a2d-b7c7-e4cb1706f251" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Deleting offline snapshot 73511bd2-ab56-4a2d-b7c7-e4cb1706f251 of volume 33f43cf6-d8ce-4868-a52b-d0dc1e8c646f {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] snapshot_file for this snap is: volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe5a42-de71-435b-84df-d2d52574dd51]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:47 devstack sudo[110211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 Sep 05 04:59:47 devstack sudo[110211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:47 devstack sudo[110211]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:47 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:48 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b4fa75-5209-4036-be95-48e693b9d3b1]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:48 devstack sudo[110216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f Sep 05 04:59:48 devstack sudo[110216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:48 devstack sudo[110216]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" returned: 0 in 0.433s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:48 devstack sudo[110221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 Sep 05 04:59:48 devstack sudo[110221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:48 devstack sudo[110221]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251" returned: 0 in 0.460s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:48 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:48 devstack sudo[110226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251 Sep 05 04:59:48 devstack sudo[110226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:49 devstack sudo[110226]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f.73511bd2-ab56-4a2d-b7c7-e4cb1706f251" returned: 0 in 0.275s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-73511bd2-ab56-4a2d-b7c7-e4cb1706f251" released by "_delete_snapshot" :: held 1.669s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" released by "delete_snapshot" :: held 1.697s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Created reservations ['a1fb2406-b853-40c1-924d-adac8950b6f8', '59b9ee26-94bf-402e-bd6f-e49eae088c11', '3af002fa-1ee4-40a6-8229-fcd13fb2072c', 'bb6953f3-2ebb-4d5d-b08d-64714fa2629a'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:49 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Delete snapshot completed successfully. Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-8c8c91b5-503b-4972-a5ed-8153d43b9fbb tempest-ProjectMemberTests-181407164 None] Lock "cinder-73511bd2-ab56-4a2d-b7c7-e4cb1706f251-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Lock "cinder-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" acquired by "delete_volume" :: waited 0.020s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edf1a4d-3366-49a3-bbc4-1e676fc3ac0a]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:49 devstack sudo[110229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Flow 'volume_create_manager' (dd646f27-1e52-4054-a2c3-7994e7e9fef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:49 devstack sudo[110229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2399d1ca-a97e-4553-bca5-4d009f6ee15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2399d1ca-a97e-4553-bca5-4d009f6ee15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1187452868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beadf8b1-b36c-49fd-b2c5-c7c49180ca01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ebfbef19b743f5b3c0a6736d7afd7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:50Z,use_quota=True,user_id='7ca33f00904340f79c84e4df42d7863e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279baa51-6068-454c-ba5f-6d5f054d1762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279baa51-6068-454c-ba5f-6d5f054d1762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027b62cd-b5ec-4f45-b907-cff202a64ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027b62cd-b5ec-4f45-b907-cff202a64ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beadf8b1-b36c-49fd-b2c5-c7c49180ca01', 'volume_name': 'volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35d3320-c687-4677-90b6-5e06a65b2500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35d3320-c687-4677-90b6-5e06a65b2500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:49 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d7512f-9183-4603-a3d6-29a9b6845a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:50 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Volume beadf8b1-b36c-49fd-b2c5-c7c49180ca01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01', 'volume_size': 1} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1187452868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beadf8b1-b36c-49fd-b2c5-c7c49180ca01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ebfbef19b743f5b3c0a6736d7afd7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:50Z,use_quota=True,user_id='7ca33f00904340f79c84e4df42d7863e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Creating volume beadf8b1-b36c-49fd-b2c5-c7c49180ca01 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:50 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:50 devstack sudo[110231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 1073741824 Sep 05 04:59:50 devstack sudo[110231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:50 devstack sudo[110229]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" returned: 0 in 0.404s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:50 devstack sudo[110236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f Sep 05 04:59:50 devstack sudo[110236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:50 devstack sudo[110231]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 1073741824" returned: 0 in 0.438s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:50 devstack sudo[110236]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" returned: 0 in 0.292s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:50 devstack sudo[110242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 Sep 05 04:59:50 devstack sudo[110242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f" released by "delete_volume" :: held 0.765s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Created reservations ['492a23c1-3a94-411f-9b1f-a42c1341a58e', '1885d929-45f4-430a-bcc8-abfefc4c2b0b', '5abdbe26-5de5-4627-987a-f36338e2c9e5', 'f9e790fb-f8b8-4ca2-8ec7-9dad9ff8f09b'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:50 devstack sudo[110244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 04:59:50 devstack sudo[110244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:50 devstack sudo[110242]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" returned: 0 in 0.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d7512f-9183-4603-a3d6-29a9b6845a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1935c2a0-ea23-4ca1-8cf9-87f2a0264a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:50 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Volume volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 (beadf8b1-b36c-49fd-b2c5-c7c49180ca01): created successfully Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1935c2a0-ea23-4ca1-8cf9-87f2a0264a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Flow 'volume_create_manager' (dd646f27-1e52-4054-a2c3-7994e7e9fef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:50 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-dbb7a2f4-92bf-491e-9f01-50b6af404813 tempest-SnapshotDependencyTests-501224874 None] Created volume successfully. Sep 05 04:59:50 devstack sudo[110244]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.294s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 04:59:50 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Deleted volume successfully. Sep 05 04:59:50 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7344986b-7452-47fc-8c66-cff20f8a2de5 tempest-ProjectMemberTests-181407164 None] Lock "cinder-33f43cf6-d8ce-4868-a52b-d0dc1e8c646f-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (fcf108a7-03cc-4be2-a541-5df428f8f67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802cc164-b7f7-47f1-a025-fb1444f41c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802cc164-b7f7-47f1-a025-fb1444f41c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980845550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b11304-7144-414b-a8ba-b6104a60db30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:51Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a559d71-6b5b-4b84-8a76-3deb81aac573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a559d71-6b5b-4b84-8a76-3deb81aac573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd6fd11-e566-4502-8947-ede44e1b30a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd6fd11-e566-4502-8947-ede44e1b30a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b11304-7144-414b-a8ba-b6104a60db30', 'volume_name': 'volume-b6b11304-7144-414b-a8ba-b6104a60db30', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d70480f-7363-4968-b0ab-9540acafcfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d70480f-7363-4968-b0ab-9540acafcfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ce00d5-7b40-458a-959b-5f75baaa9c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:51 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Volume b6b11304-7144-414b-a8ba-b6104a60db30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b11304-7144-414b-a8ba-b6104a60db30', 'volume_size': 1} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980845550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b11304-7144-414b-a8ba-b6104a60db30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:51Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Creating volume b6b11304-7144-414b-a8ba-b6104a60db30 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:51 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:51 devstack sudo[110248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 1073741824 Sep 05 04:59:51 devstack sudo[110248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:51 devstack sudo[110248]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 1073741824" returned: 0 in 0.420s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:51 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:51 devstack sudo[110254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 Sep 05 04:59:51 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:52 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30" returned: 0 in 0.262s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.677s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ce00d5-7b40-458a-959b-5f75baaa9c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b11304-7144-414b-a8ba-b6104a60db30', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78ebbb7-0c40-4794-a131-e1271336432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Creating offline snapshot 2e621240-f74c-4f3a-b769-73c21b5a723a of volume beadf8b1-b36c-49fd-b2c5-c7c49180ca01 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:59:52 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Volume volume-b6b11304-7144-414b-a8ba-b6104a60db30 (b6b11304-7144-414b-a8ba-b6104a60db30): created successfully Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78ebbb7-0c40-4794-a131-e1271336432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (fcf108a7-03cc-4be2-a541-5df428f8f67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a35e2a-ab2d-41a9-bd37-96bd497f4ffd]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:52 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-4e5278f8-18aa-482c-8551-30d51da8cfe8 tempest-ProjectMemberTests-181407164 None] Created volume successfully. Sep 05 04:59:52 devstack sudo[110257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 Sep 05 04:59:52 devstack sudo[110257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:52 devstack sudo[110257]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" returned: 0 in 0.392s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:52 devstack sudo[110262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a 1G Sep 05 04:59:52 devstack sudo[110262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:52 devstack sudo[110262]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a 1G" returned: 0 in 0.378s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:52 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:52 devstack sudo[110267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a Sep 05 04:59:52 devstack sudo[110267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:53 devstack sudo[110267]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a" returned: 0 in 0.284s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:53 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a is being set with open permissions: ugo+rw Sep 05 04:59:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:53 devstack sudo[110272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a Sep 05 04:59:53 devstack sudo[110272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:53 devstack sudo[110272]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a" returned: 0 in 0.250s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:53 devstack sudo[110275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.info Sep 05 04:59:53 devstack sudo[110275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:53 devstack sudo[110275]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.info" returned: 0 in 0.249s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:53 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.info is being set with open permissions: ugo+rw Sep 05 04:59:53 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:53 devstack sudo[110278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.info Sep 05 04:59:53 devstack sudo[110278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:54 devstack sudo[110278]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.info" returned: 0 in 0.248s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.535s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:54 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Creating offline snapshot ce196ef3-9038-43f2-a8e8-c935a051b83a of volume b6b11304-7144-414b-a8ba-b6104a60db30 {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 04:59:54 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b0f80d3d-69cf-4547-b7d8-198c747d9680 tempest-SnapshotDependencyTests-501224874 None] Create snapshot completed successfully Sep 05 04:59:54 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e45b73-e09e-4393-b9a2-f31fd2e77d28]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:54 devstack sudo[110281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 Sep 05 04:59:54 devstack sudo[110281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:54 devstack sudo[110281]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30" returned: 0 in 0.355s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:54 devstack sudo[110286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a 1G Sep 05 04:59:54 devstack sudo[110286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:54 devstack sudo[110286]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a 1G" returned: 0 in 0.403s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:54 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b11304-7144-414b-a8ba-b6104a60db30 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:54 devstack sudo[110293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b11304-7144-414b-a8ba-b6104a60db30 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a Sep 05 04:59:54 devstack sudo[110293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:55 devstack sudo[110293]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b11304-7144-414b-a8ba-b6104a60db30 -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a" returned: 0 in 0.311s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:55 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a is being set with open permissions: ugo+rw Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:55 devstack sudo[110299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a Sep 05 04:59:55 devstack sudo[110299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Flow 'volume_create_manager' (c9f8a371-32b7-436e-aaeb-7922eab9cfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1d5cd9-2719-4776-be04-12f44d50e35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1d5cd9-2719-4776-be04-12f44d50e35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T02:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca646aa-b001-47d6-9401-23e749c68033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ebfbef19b743f5b3c0a6736d7afd7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T02:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2e621240-f74c-4f3a-b769-73c21b5a723a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T02:59:55Z,use_quota=True,user_id='7ca33f00904340f79c84e4df42d7863e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32c2eaf-2e87-4448-a4a4-8aaf7419e6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32c2eaf-2e87-4448-a4a4-8aaf7419e6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683703ed-f836-49bc-9cea-96c5052afb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683703ed-f836-49bc-9cea-96c5052afb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eca646aa-b001-47d6-9401-23e749c68033', 'volume_name': 'volume-eca646aa-b001-47d6-9401-23e749c68033', 'volume_size': 1, 'snapshot_id': '2e621240-f74c-4f3a-b769-73c21b5a723a'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198374c2-6a0c-44d7-b8fb-1fe1517cf2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198374c2-6a0c-44d7-b8fb-1fe1517cf2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a185d828-ccf4-436c-9e92-b8edc658a1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 04:59:55 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Volume eca646aa-b001-47d6-9401-23e749c68033: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eca646aa-b001-47d6-9401-23e749c68033', 'volume_size': 1, 'snapshot_id': '2e621240-f74c-4f3a-b769-73c21b5a723a'} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:55 devstack sudo[110299]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a" returned: 0 in 0.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:55 devstack sudo[110302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.info Sep 05 04:59:55 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:55 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.info" returned: 0 in 0.251s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:55 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.info is being set with open permissions: ugo+rw Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:55 devstack sudo[110305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.info Sep 05 04:59:55 devstack sudo[110305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:55 devstack sudo[110305]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.info" returned: 0 in 0.244s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.637s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "cinder-quobyte-2e621240-f74c-4f3a-b769-73c21b5a723a-eca646aa-b001-47d6-9401-23e749c68033" by "_create_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=200,cinder:INSERT=71,cinder:UPDATE=279,cinder:DELETE=22 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=200,cinder:UPDATE=257,cinder:INSERT=71,cinder:DELETE=22 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-2e621240-f74c-4f3a-b769-73c21b5a723a-eca646aa-b001-47d6-9401-23e749c68033" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Creating volume eca646aa-b001-47d6-9401-23e749c68033 from snapshot 2e621240-f74c-4f3a-b769-73c21b5a723a {{(pid=89807) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "cinder-quobyte-eca646aa-b001-47d6-9401-23e749c68033" by "_copy_volume_from_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:55 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-00eeef32-fe96-42bf-a02c-3882211f1ca6 tempest-ProjectMemberTests-181407164 None] Create snapshot completed successfully Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-eca646aa-b001-47d6-9401-23e749c68033" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:55 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] snapshot: 2e621240-f74c-4f3a-b769-73c21b5a723a, volume: eca646aa-b001-47d6-9401-23e749c68033, {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[575e97fa-ddd8-441c-b730-8382ffa25e8b]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:56 devstack sudo[110308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a Sep 05 04:59:56 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:56 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a" returned: 0 in 0.373s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52f816b-f609-4dba-b47d-43edf2d1a8e7]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:56 devstack sudo[110313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 Sep 05 04:59:56 devstack sudo[110313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-ce196ef3-9038-43f2-a8e8-c935a051b83a-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Lock "cinder-ce196ef3-9038-43f2-a8e8-c935a051b83a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-b6b11304-7144-414b-a8ba-b6104a60db30" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-b6b11304-7144-414b-a8ba-b6104a60db30" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-ce196ef3-9038-43f2-a8e8-c935a051b83a" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-ce196ef3-9038-43f2-a8e8-c935a051b83a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Deleting offline snapshot ce196ef3-9038-43f2-a8e8-c935a051b83a of volume b6b11304-7144-414b-a8ba-b6104a60db30 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] snapshot_file for this snap is: volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaddd91-17c2-453b-9b02-a3d5dedb386e]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:56 devstack sudo[110313]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" returned: 0 in 0.374s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Creating direct copy from snapshot {{(pid=89807) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG cinder.utils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Path /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 not found in is_blk_device check {{(pid=89807) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 04:59:56 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:56 devstack sudo[110319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 Sep 05 04:59:56 devstack sudo[110319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:56 devstack sudo[110318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a Sep 05 04:59:56 devstack sudo[110318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:57 devstack sudo[110318]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:57 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b11304-7144-414b-a8ba-b6104a60db30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 04:59:57 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef4084e-d6d2-413d-b802-2ff7f9e89279]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 04:59:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:57 devstack sudo[110330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 Sep 05 04:59:57 devstack sudo[110330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:57 devstack sudo[110330]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30" returned: 0 in 0.542s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:57 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:57 devstack sudo[110342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a Sep 05 04:59:57 devstack sudo[110342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:58 devstack sudo[110342]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a" returned: 0 in 0.757s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:58 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 04:59:58 devstack sudo[110347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a Sep 05 04:59:58 devstack sudo[110347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 04:59:59 devstack sudo[110347]: pam_unix(sudo:session): session closed for user root Sep 05 04:59:59 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30.ce196ef3-9038-43f2-a8e8-c935a051b83a" returned: 0 in 0.914s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 04:59:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-ce196ef3-9038-43f2-a8e8-c935a051b83a" released by "_delete_snapshot" :: held 2.745s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-b6b11304-7144-414b-a8ba-b6104a60db30" released by "delete_snapshot" :: held 2.779s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 04:59:59 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Created reservations ['2a94e748-cfd2-4915-b207-b92994e01618', '794e8615-2e06-4585-97f1-f185f5c803b2', '1a393e59-5fca-4190-9b64-d3a2614a0f89', '3891c5e6-0f8f-40f5-b62a-97dfbdbe2b2a'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 04:59:59 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Delete snapshot completed successfully. Sep 05 04:59:59 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-75e4cffd-9370-42a6-b2cd-cfeebe23c54c tempest-ProjectMemberTests-181407164 None] Lock "cinder-ce196ef3-9038-43f2-a8e8-c935a051b83a-delete_snapshot" released by "delete_snapshot" :: held 3.039s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-b6b11304-7144-414b-a8ba-b6104a60db30-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Lock "cinder-b6b11304-7144-414b-a8ba-b6104a60db30-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-b6b11304-7144-414b-a8ba-b6104a60db30" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:00 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-b6b11304-7144-414b-a8ba-b6104a60db30" acquired by "delete_volume" :: waited 0.030s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:00 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd837b31-d602-42a3-b9b4-5e72c8526f5d]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:00 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:00 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 Sep 05 05:00:00 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:01 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30" returned: 0 in 0.674s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:01 devstack sudo[110356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30 Sep 05 05:00:01 devstack sudo[110356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:01 devstack sudo[110319]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033" returned: 0 in 4.591s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.image.image_utils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Image conversion details: src /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01, size 1024.00 MB, duration 4.59 sec, destination /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 {{(pid=89807) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 05:00:01 devstack cinder-volume[89807]: INFO cinder.image.image_utils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Converted 1024.00 MB image at 222.96 MB/s Sep 05 05:00:01 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 is being set with open permissions: ugo+rw Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:01 devstack sudo[110358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 Sep 05 05:00:01 devstack sudo[110358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:01 devstack sudo[110356]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b6b11304-7144-414b-a8ba-b6104a60db30" returned: 0 in 0.449s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-b6b11304-7144-414b-a8ba-b6104a60db30" released by "delete_volume" :: held 1.257s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Created reservations ['d69615b3-8efa-45dd-b6e9-f35c556ff599', 'e1886cf0-8f0a-449e-9778-83753ecf5c1e', '70033221-2c73-4ba4-97e0-0672fe7cfb89', '7dc0479d-0bba-4cd2-91bf-6ea0caa10aef'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:01 devstack sudo[110358]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:01 devstack sudo[110362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033" returned: 0 in 0.255s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:01 devstack sudo[110362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-eca646aa-b001-47d6-9401-23e749c68033" released by "_copy_volume_from_snapshot" :: held 5.671s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-2e621240-f74c-4f3a-b769-73c21b5a723a-eca646aa-b001-47d6-9401-23e749c68033" released by "_create_volume_from_snapshot" :: held 5.748s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.782s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a185d828-ccf4-436c-9e92-b8edc658a1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca646aa-b001-47d6-9401-23e749c68033', 'volume_size': 1, 'snapshot_id': '2e621240-f74c-4f3a-b769-73c21b5a723a'}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d74af9-c7dd-466b-bb5b-6b020d673f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:01 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Volume volume-eca646aa-b001-47d6-9401-23e749c68033 (eca646aa-b001-47d6-9401-23e749c68033): created successfully Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d74af9-c7dd-466b-bb5b-6b020d673f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Flow 'volume_create_manager' (c9f8a371-32b7-436e-aaeb-7922eab9cfa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:00:01 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-749ac806-1901-4c80-b385-3d1b96792a8d tempest-SnapshotDependencyTests-501224874 None] Created volume successfully. Sep 05 05:00:01 devstack sudo[110362]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.248s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:00:01 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Deleted volume successfully. Sep 05 05:00:01 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-1a6af0f6-caff-46c2-8ec9-2a1390ecdd28 tempest-ProjectMemberTests-181407164 None] Lock "cinder-b6b11304-7144-414b-a8ba-b6104a60db30-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:02 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "cinder-2e621240-f74c-4f3a-b769-73c21b5a723a-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:02 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:00:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (667255f8-7faa-4da1-a1fd-c59435cb3d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:00:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956818fe-ebe5-412a-8974-2af383cd8b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956818fe-ebe5-412a-8974-2af383cd8b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534626053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925430d6-b2f7-4fa1-b783-83236d0e123e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:00:03Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dc50c6-5b27-4f4c-aa9d-1c66b2235fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dc50c6-5b27-4f4c-aa9d-1c66b2235fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07683dea-1e74-431d-a686-4b8204c8c3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:02 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07683dea-1e74-431d-a686-4b8204c8c3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925430d6-b2f7-4fa1-b783-83236d0e123e', 'volume_name': 'volume-925430d6-b2f7-4fa1-b783-83236d0e123e', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b868e9-40ce-4d16-86ca-d686c415a486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b868e9-40ce-4d16-86ca-d686c415a486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953f0ad1-26ea-4240-ad12-e3587837879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:03 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Volume 925430d6-b2f7-4fa1-b783-83236d0e123e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925430d6-b2f7-4fa1-b783-83236d0e123e', 'volume_size': 1} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534626053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925430d6-b2f7-4fa1-b783-83236d0e123e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994d49b4ff0d45a881657502871b0c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:00:03Z,use_quota=True,user_id='1474903149e04aac921bbf89487d1d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Creating volume 925430d6-b2f7-4fa1-b783-83236d0e123e {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:00:03 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-2e621240-f74c-4f3a-b769-73c21b5a723a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.118s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "cinder-quobyte-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:03 devstack sudo[110365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e 1073741824 Sep 05 05:00:03 devstack sudo[110365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "cinder-quobyte-2e621240-f74c-4f3a-b769-73c21b5a723a" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-2e621240-f74c-4f3a-b769-73c21b5a723a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Deleting offline snapshot 2e621240-f74c-4f3a-b769-73c21b5a723a of volume beadf8b1-b36c-49fd-b2c5-c7c49180ca01 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] snapshot_file for this snap is: volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21ab1bb-031d-4edc-9235-7c0676a457ce]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:03 devstack sudo[110367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a Sep 05 05:00:03 devstack sudo[110367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:03 devstack sudo[110365]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e 1073741824" returned: 0 in 0.396s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:03 devstack sudo[110367]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a" returned: 0 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:00:03 devstack sudo[110375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e Sep 05 05:00:03 devstack sudo[110375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c03c782-9b26-4b64-ab56-98005f8fc8a8]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:03 devstack sudo[110377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 Sep 05 05:00:03 devstack sudo[110377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:03 devstack sudo[110375]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e" returned: 0 in 0.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953f0ad1-26ea-4240-ad12-e3587837879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925430d6-b2f7-4fa1-b783-83236d0e123e', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9c6421-1e26-4c26-96ef-bf7ce168c48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:03 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Volume volume-925430d6-b2f7-4fa1-b783-83236d0e123e (925430d6-b2f7-4fa1-b783-83236d0e123e): created successfully Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9c6421-1e26-4c26-96ef-bf7ce168c48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:03 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Flow 'volume_create_manager' (667255f8-7faa-4da1-a1fd-c59435cb3d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:00:03 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-9dca131f-19df-4144-ad0f-890109d17e27 tempest-ProjectMemberTests-181407164 None] Created volume successfully. Sep 05 05:00:04 devstack sudo[110377]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" returned: 0 in 0.560s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:04 devstack sudo[110383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a Sep 05 05:00:04 devstack sudo[110383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Creating offline snapshot 3da037c5-1ff7-4973-8dff-4cfc0df12ab4 of volume 925430d6-b2f7-4fa1-b783-83236d0e123e {{(pid=89807) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfcb09a-b6a5-4b17-8162-4a30479f2a35]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:04 devstack sudo[110385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e Sep 05 05:00:04 devstack sudo[110385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:04 devstack sudo[110383]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a" returned: 0 in 0.344s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:04 devstack sudo[110390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a Sep 05 05:00:04 devstack sudo[110390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:04 devstack sudo[110385]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e" returned: 0 in 0.371s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 1G {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:04 devstack sudo[110395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 1G Sep 05 05:00:04 devstack sudo[110395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:04 devstack sudo[110390]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01.2e621240-f74c-4f3a-b769-73c21b5a723a" returned: 0 in 0.267s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-2e621240-f74c-4f3a-b769-73c21b5a723a" released by "_delete_snapshot" :: held 1.637s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" released by "delete_snapshot" :: held 1.661s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Created reservations ['fb882c47-90a1-4765-9917-06881f79a088', '9798745c-6aaa-4934-b6d2-d06ea22423ce', 'e7037291-bb5f-488e-b9db-1eaa0f7f7ec9', '679548fd-04db-4b01-8642-6e9cecdd0e06'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:00:04 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Delete snapshot completed successfully. Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-46b8d251-9ded-4d44-b5be-8a0006a8724f tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-2e621240-f74c-4f3a-b769-73c21b5a723a-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:04 devstack sudo[110395]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 1G" returned: 0 in 0.406s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:04 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925430d6-b2f7-4fa1-b783-83236d0e123e -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:04 devstack sudo[110403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925430d6-b2f7-4fa1-b783-83236d0e123e -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 Sep 05 05:00:04 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "cinder-beadf8b1-b36c-49fd-b2c5-c7c49180ca01-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-beadf8b1-b36c-49fd-b2c5-c7c49180ca01-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "cinder-quobyte-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" acquired by "delete_volume" :: waited 0.014s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e3c790-a53f-4b5b-b33d-fe96a50b1c7c]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:05 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925430d6-b2f7-4fa1-b783-83236d0e123e -F qcow2 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4" returned: 0 in 0.307s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:05 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 is being set with open permissions: ugo+rw Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:05 devstack sudo[110409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 Sep 05 05:00:05 devstack sudo[110409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:05 devstack sudo[110408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 Sep 05 05:00:05 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:05 devstack sudo[110409]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4" returned: 0 in 0.246s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:05 devstack sudo[110415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.info Sep 05 05:00:05 devstack sudo[110415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:05 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" returned: 0 in 0.382s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:05 devstack sudo[110419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01 Sep 05 05:00:05 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:05 devstack sudo[110415]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.info" returned: 0 in 0.283s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:05 devstack cinder-volume[89807]: WARNING cinder.volume.drivers.remotefs [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.info is being set with open permissions: ugo+rw Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.info {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:05 devstack sudo[110422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.info Sep 05 05:00:05 devstack sudo[110422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:05 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" returned: 0 in 0.255s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-beadf8b1-b36c-49fd-b2c5-c7c49180ca01" released by "delete_volume" :: held 0.692s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Created reservations ['d828d230-a1b2-46a7-985c-cfe9e7bfac99', '556f37e5-5f17-4953-a2c4-83a12ae5621d', 'f811f6d8-5e72-4334-bed5-9b26f95cd01f', 'f468edeb-2bd3-4a77-a55a-5d749f849241'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:05 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:06 devstack sudo[110426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 05:00:06 devstack sudo[110426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:06 devstack sudo[110422]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.info" returned: 0 in 0.276s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-93bef22a-e3d1-4318-855f-83ce61862093 tempest-ProjectMemberTests-181407164 None] Create snapshot completed successfully Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "cinder-eca646aa-b001-47d6-9401-23e749c68033-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-eca646aa-b001-47d6-9401-23e749c68033-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:06 devstack sudo[110426]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.290s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:00:06 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Deleted volume successfully. Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "cinder-quobyte-eca646aa-b001-47d6-9401-23e749c68033" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-3d7e1f67-7222-4e46-8b63-39f7f78fd1b6 tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-beadf8b1-b36c-49fd-b2c5-c7c49180ca01-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-eca646aa-b001-47d6-9401-23e749c68033" acquired by "delete_volume" :: waited 0.021s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[7389ea5f-aeb5-47b6-8198-72e1bab3a2b6]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-3da037c5-1ff7-4973-8dff-4cfc0df12ab4-delete_snapshot" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Lock "cinder-3da037c5-1ff7-4973-8dff-4cfc0df12ab4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-925430d6-b2f7-4fa1-b783-83236d0e123e" by "delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-925430d6-b2f7-4fa1-b783-83236d0e123e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-3da037c5-1ff7-4973-8dff-4cfc0df12ab4" by "_delete_snapshot" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-3da037c5-1ff7-4973-8dff-4cfc0df12ab4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Deleting offline snapshot 3da037c5-1ff7-4973-8dff-4cfc0df12ab4 of volume 925430d6-b2f7-4fa1-b783-83236d0e123e {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] snapshot_file for this snap is: volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 {{(pid=89807) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[e688cd16-e518-41a5-8dd8-e6fa156f5211]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:06 devstack sudo[110429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 Sep 05 05:00:06 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:06 devstack sudo[110430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 Sep 05 05:00:06 devstack sudo[110430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:06 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033" returned: 0 in 0.390s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:06 devstack sudo[110437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033 Sep 05 05:00:06 devstack sudo[110437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:06 devstack sudo[110430]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4" returned: 0 in 0.366s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-925430d6-b2f7-4fa1-b783-83236d0e123e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89807) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2044c271-2ef2-4b39-b2dc-d1f831507266]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:06 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:06 devstack sudo[110441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e Sep 05 05:00:06 devstack sudo[110441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:07 devstack sudo[110437]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-eca646aa-b001-47d6-9401-23e749c68033" returned: 0 in 0.271s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-quobyte-eca646aa-b001-47d6-9401-23e749c68033" released by "delete_volume" :: held 0.704s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Created reservations ['2d793901-2fee-41af-80d8-0765b10a3f21', '78b47d5a-727a-440a-9bfd-0a0739b97c09', '483f8128-09d2-4d8b-afb0-e45f15bf244f', 'd3048bff-36be-4c67-b07d-700df90249ab'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:07 devstack sudo[110446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 05:00:07 devstack sudo[110446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:07 devstack sudo[110441]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e" returned: 0 in 0.361s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:07 devstack sudo[110449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 Sep 05 05:00:07 devstack sudo[110449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:07 devstack sudo[110446]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.260s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:00:07 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Deleted volume successfully. Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-dc4c5020-0722-4b4d-ad1d-7a448277f99e tempest-SnapshotDependencyTests-501224874 None] Lock "cinder-eca646aa-b001-47d6-9401-23e749c68033-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:07 devstack sudo[110449]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4" returned: 0 in 0.376s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:07 devstack sudo[110456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4 Sep 05 05:00:07 devstack sudo[110456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:07 devstack sudo[110456]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e.3da037c5-1ff7-4973-8dff-4cfc0df12ab4" returned: 0 in 0.244s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-3da037c5-1ff7-4973-8dff-4cfc0df12ab4" released by "_delete_snapshot" :: held 1.437s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-925430d6-b2f7-4fa1-b783-83236d0e123e" released by "delete_snapshot" :: held 1.464s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:07 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Created reservations ['88a74808-d634-4806-878e-49c4683127ab', 'da902800-13a2-4dfa-8fa2-315eebb0382b', '9fc129d6-100b-4c9f-90eb-977d5a230034', '8ea2c0f7-d8b2-411f-9f3d-3a747eb8c12b'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:00:08 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Delete snapshot completed successfully. Sep 05 05:00:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-997d595f-7d9d-42bc-bc5f-6533222b0dba tempest-ProjectMemberTests-181407164 None] Lock "cinder-3da037c5-1ff7-4973-8dff-4cfc0df12ab4-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-925430d6-b2f7-4fa1-b783-83236d0e123e-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Lock "cinder-925430d6-b2f7-4fa1-b783-83236d0e123e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Acquiring lock "cinder-quobyte-925430d6-b2f7-4fa1-b783-83236d0e123e" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:08 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-925430d6-b2f7-4fa1-b783-83236d0e123e" acquired by "delete_volume" :: waited 0.015s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:08 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d106e40e-a49b-43db-b0f4-8ea80c105765]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:08 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:08 devstack sudo[110461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e Sep 05 05:00:08 devstack sudo[110461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:09 devstack sudo[110461]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e" returned: 0 in 0.397s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:09 devstack sudo[110467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e Sep 05 05:00:09 devstack sudo[110467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:09 devstack sudo[110467]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-925430d6-b2f7-4fa1-b783-83236d0e123e" returned: 0 in 0.249s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Lock "cinder-quobyte-925430d6-b2f7-4fa1-b783-83236d0e123e" released by "delete_volume" :: held 0.708s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Created reservations ['447dbc9f-c475-4c58-b2a6-33a667770bd2', '4c1a10e2-0bfd-4e52-b348-1fbbb3100b58', '841359c5-843a-4685-9dd4-cfcfbbe94376', '8fce2254-98db-4fbb-948e-6673fdb62d96'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:09 devstack sudo[110470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 05:00:09 devstack sudo[110470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:09 devstack sudo[110470]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.253s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:00:09 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Deleted volume successfully. Sep 05 05:00:09 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-a6fbbb07-ebb0-4918-bac5-32f3820af0ee tempest-ProjectMemberTests-181407164 None] Lock "cinder-925430d6-b2f7-4fa1-b783-83236d0e123e-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:10 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:00:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:10 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:10 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:10 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 05:00:10 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:11 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:11 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.383s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:11 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:00:11 devstack cinder-volume[89807]: DEBUG oslo_service.periodic_task [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=89807) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 05:00:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread count: 29 {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 05:00:11 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-a7e85b11-7462-4753-b56c-4f9a1db63ff9 None None] thread info: [<_MainThread(MainThread, started 126198271074432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89807) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 05:00:24 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=42,cinder:INSERT=16,cinder:UPDATE=55,cinder:DELETE=3 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:00:24 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:DELETE=5,cinder:SELECT=41,cinder:INSERT=15,cinder:UPDATE=57 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Flow 'volume_create_manager' (30d38433-8355-477c-9542-74b6c6602e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9c36f3-efe8-4a62-a2b9-286f26651939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9c36f3-efe8-4a62-a2b9-286f26651939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404402473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05caeac3-7275-48d9-9281-29c02774be32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc44e2b3c3d479aaf1b6b163dc3e201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:00:30Z,use_quota=True,user_id='49effb72d48f4350ae13d2646745cacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56547148-a47f-433a-ae14-1d5e2d3a55fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56547148-a47f-433a-ae14-1d5e2d3a55fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ded2fc4-592b-457f-bc2c-d1c5d5838224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ded2fc4-592b-457f-bc2c-d1c5d5838224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05caeac3-7275-48d9-9281-29c02774be32', 'volume_name': 'volume-05caeac3-7275-48d9-9281-29c02774be32', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb261c9-1007-44a8-aa79-3a7cd9bc4865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb261c9-1007-44a8-aa79-3a7cd9bc4865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f57685e-e7d5-4b53-bf35-5e9da5294b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Volume 05caeac3-7275-48d9-9281-29c02774be32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05caeac3-7275-48d9-9281-29c02774be32', 'volume_size': 1} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404402473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05caeac3-7275-48d9-9281-29c02774be32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc44e2b3c3d479aaf1b6b163dc3e201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:00:30Z,use_quota=True,user_id='49effb72d48f4350ae13d2646745cacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Creating volume 05caeac3-7275-48d9-9281-29c02774be32 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:00:30 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:30 devstack sudo[110527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32 1073741824 Sep 05 05:00:30 devstack sudo[110527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:30 devstack sudo[110527]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32 1073741824" returned: 0 in 0.412s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:30 devstack sudo[110532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32 Sep 05 05:00:30 devstack sudo[110532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:30 devstack sudo[110532]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32" returned: 0 in 0.258s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f57685e-e7d5-4b53-bf35-5e9da5294b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05caeac3-7275-48d9-9281-29c02774be32', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fef9513-0914-4aff-bbc1-9828d75b3e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:30 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Volume volume-05caeac3-7275-48d9-9281-29c02774be32 (05caeac3-7275-48d9-9281-29c02774be32): created successfully Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fef9513-0914-4aff-bbc1-9828d75b3e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:30 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Flow 'volume_create_manager' (30d38433-8355-477c-9542-74b6c6602e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:00:30 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-b6170cd6-8dcc-4111-bf62-b0d59879b658 tempest-ProjectReaderTests-881210329 None] Created volume successfully. Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Acquiring lock "cinder-05caeac3-7275-48d9-9281-29c02774be32-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Lock "cinder-05caeac3-7275-48d9-9281-29c02774be32-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Acquiring lock "cinder-quobyte-05caeac3-7275-48d9-9281-29c02774be32" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Lock "cinder-quobyte-05caeac3-7275-48d9-9281-29c02774be32" acquired by "delete_volume" :: waited 0.013s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[2890c881-34dc-4a42-b251-317a2b226a43]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:31 devstack sudo[110535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32 Sep 05 05:00:31 devstack sudo[110535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:31 devstack sudo[110535]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32" returned: 0 in 0.357s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:31 devstack sudo[110540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32 Sep 05 05:00:31 devstack sudo[110540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:31 devstack sudo[110540]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-05caeac3-7275-48d9-9281-29c02774be32" returned: 0 in 0.256s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Lock "cinder-quobyte-05caeac3-7275-48d9-9281-29c02774be32" released by "delete_volume" :: held 0.648s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:31 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Created reservations ['1746974f-414a-4b69-bbc1-7ae825b3d2a6', '513e2816-b204-4784-8377-35d2bf3ef57a', '78dd97b8-b9e1-40af-bfae-1bc7670a98ea', '51165e34-c9ce-407e-86db-499014d5f254'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:32 devstack sudo[110543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 05:00:32 devstack sudo[110543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:32 devstack sudo[110543]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.234s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:00:32 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Deleted volume successfully. Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-7ba24e09-ca0d-4f79-bb41-5c98702d176a tempest-ProjectReaderTests-881210329 None] Lock "cinder-05caeac3-7275-48d9-9281-29c02774be32-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89807) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Flow 'volume_create_manager' (6bfcd718-493a-4034-a8b0-dc9bb29024a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba27e7e-1d57-499d-8349-862fd42116d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba27e7e-1d57-499d-8349-862fd42116d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355544751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f2c5d0-66cc-4a11-9fa0-caab4b413228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc44e2b3c3d479aaf1b6b163dc3e201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:00:33Z,use_quota=True,user_id='49effb72d48f4350ae13d2646745cacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acf5856-b528-416f-8c4e-c60dd1c9c314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acf5856-b528-416f-8c4e-c60dd1c9c314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c5158f-6c5b-43d1-8e2e-7849869d34d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c5158f-6c5b-43d1-8e2e-7849869d34d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f2c5d0-66cc-4a11-9fa0-caab4b413228', 'volume_name': 'volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc6d089-59d0-404d-80f4-8220011e7a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc6d089-59d0-404d-80f4-8220011e7a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afd515d-9a4d-4525-9eda-910c40f90808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:32 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Volume b8f2c5d0-66cc-4a11-9fa0-caab4b413228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228', 'volume_size': 1} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T03:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355544751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f2c5d0-66cc-4a11-9fa0-caab4b413228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc44e2b3c3d479aaf1b6b163dc3e201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T03:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T03:00:33Z,use_quota=True,user_id='49effb72d48f4350ae13d2646745cacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e98cd512-7611-485b-90a0-8d2a77aacc96),volume_type_id=e98cd512-7611-485b-90a0-8d2a77aacc96)}" {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.remotefs [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Creating volume b8f2c5d0-66cc-4a11-9fa0-caab4b413228 {{(pid=89807) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Selected osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b as target Quobyte volume. {{(pid=89807) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 05:00:32 devstack cinder-volume[89807]: INFO cinder.volume.drivers.remotefs [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] casted to osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b Sep 05 05:00:32 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228 1073741824 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:32 devstack sudo[110546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228 1073741824 Sep 05 05:00:32 devstack sudo[110546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:33 devstack sudo[110546]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228 1073741824" returned: 0 in 0.396s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:33 devstack sudo[110552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228 Sep 05 05:00:33 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:33 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228" returned: 0 in 0.243s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'} {{(pid=89807) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afd515d-9a4d-4525-9eda-910c40f90808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228', 'volume_size': 1}' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48407601-03ba-4006-bc93-f6f0f348fec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 05:00:33 devstack cinder-volume[89807]: INFO cinder.volume.flows.manager.create_volume [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Volume volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228 (b8f2c5d0-66cc-4a11-9fa0-caab4b413228): created successfully Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48407601-03ba-4006-bc93-f6f0f348fec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89807) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Flow 'volume_create_manager' (6bfcd718-493a-4034-a8b0-dc9bb29024a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89807) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 05:00:33 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-e9b99457-ea42-4158-ba91-f300b19f48a3 tempest-ProjectReaderTests-881210329 None] Created volume successfully. Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Acquiring lock "cinder-b8f2c5d0-66cc-4a11-9fa0-caab4b413228-delete_volume" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Lock "cinder-b8f2c5d0-66cc-4a11-9fa0-caab4b413228-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Acquiring lock "cinder-quobyte-b8f2c5d0-66cc-4a11-9fa0-caab4b413228" by "delete_volume" {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Lock "cinder-quobyte-b8f2c5d0-66cc-4a11-9fa0-caab4b413228" acquired by "delete_volume" :: waited 0.016s {{(pid=89807) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8409a6f-2219-4e73-8fbe-dc4ac1b75748]: (4, 'qcow2') {{(pid=91079) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 05:00:33 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:34 devstack sudo[110555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228 Sep 05 05:00:34 devstack sudo[110555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:34 devstack sudo[110555]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228" returned: 0 in 0.354s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228 {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:34 devstack sudo[110560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228 Sep 05 05:00:34 devstack sudo[110560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:34 devstack sudo[110560]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc/volume-b8f2c5d0-66cc-4a11-9fa0-caab4b413228" returned: 0 in 0.236s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Lock "cinder-quobyte-b8f2c5d0-66cc-4a11-9fa0-caab4b413228" released by "delete_volume" :: held 0.630s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG cinder.quota [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Created reservations ['1be80716-be1b-478b-9d62-ef3949cbeaca', 'e1a92231-e9d4-451a-9d26-23e48727d83f', 'dfbec46f-0008-43ce-b694-0e1a501c74ed', '91b78754-c079-43e1-aa22-ce6b52135264'] {{(pid=89807) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b': None} {{(pid=89807) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG cinder.volume.drivers.quobyte [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21bf73a9-368f-491f-873e-80ae88eb3b6b'] {{(pid=89807) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.lockutils [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89807) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 05:00:34 devstack sudo[110563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc Sep 05 05:00:34 devstack sudo[110563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 05:00:34 devstack sudo[110563]: pam_unix(sudo:session): session closed for user root Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG oslo_concurrency.processutils [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/047cfdca1f450f1d0d271390bd0962dc" returned: 0 in 0.246s {{(pid=89807) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG cinder.manager [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Notifying Schedulers of capabilities ... {{(pid=89807) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 05:00:34 devstack cinder-volume[89807]: INFO cinder.volume.manager [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Deleted volume successfully. Sep 05 05:00:34 devstack cinder-volume[89807]: DEBUG cinder.coordination [None req-d9ea743e-5a3f-4004-9800-1fd3f1a2eb43 tempest-ProjectReaderTests-881210329 None] Lock "cinder-b8f2c5d0-66cc-4a11-9fa0-caab4b413228-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=89807) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 05:00:44 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:SELECT=15,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 05:00:44 devstack cinder-volume[89807]: DEBUG dbcounter [-] [89807] Writing DB stats cinder:UPDATE=21,cinder:SELECT=13,cinder:DELETE=3,cinder:INSERT=5 {{(pid=89807) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}